-- Logs begin at Wed 2021-12-15 10:48:50 UTC, end at Wed 2021-12-15 11:54:48 UTC. -- Dec 15 11:21:43.746399 dv-cinder-813219-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 11:21:43.753759 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 11:21:43.755758 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 11:21:43 2021] *** Dec 15 11:21:43.755758 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 11:21:43.755758 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 11:21:43.755758 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: nodename: dv-cinder-813219-3-iscsi Dec 15 11:21:43.755758 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: machine: x86_64 Dec 15 11:21:43.755758 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: clock source: unix Dec 15 11:21:43.755758 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: pcre jit disabled Dec 15 11:21:43.756258 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: detected number of CPU cores: 4 Dec 15 11:21:43.756258 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: current working directory: / Dec 15 11:21:43.756258 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: detected binary path: /usr/bin/uwsgi-core Dec 15 11:21:43.756258 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: your processes number limit is 47680 Dec 15 11:21:43.756258 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: your memory page size is 4096 bytes Dec 15 11:21:43.756258 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: detected max file descriptor number: 2048 Dec 15 11:21:43.756258 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: lock engine: pthread robust mutexes Dec 15 11:21:43.756258 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: thunder lock: enabled Dec 15 11:21:43.756258 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 11:21:43.756258 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 11:21:43.801790 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: Python main interpreter initialized at 0x5648780269c0 Dec 15 11:21:43.801790 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: python threads support enabled Dec 15 11:21:43.801790 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: your server socket listen backlog is limited to 100 connections Dec 15 11:21:43.801790 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: your mercy for graceful operations on workers is 90 seconds Dec 15 11:21:43.802150 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 11:21:43.802224 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: *** Operational MODE: preforking *** Dec 15 11:21:43.802505 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: *** uWSGI is running in multiple interpreter mode *** Dec 15 11:21:43.802505 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: spawned uWSGI master process (pid: 101691) Dec 15 11:21:43.802839 dv-cinder-813219-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 11:21:43.803966 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: spawned uWSGI worker 1 (pid: 101692, cores: 1) Dec 15 11:21:43.804722 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: spawned uWSGI worker 2 (pid: 101693, cores: 1) Dec 15 11:21:43.804722 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 11:21:45.539681 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 11:21:45.539681 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: from cryptography.utils import int_from_bytes Dec 15 11:21:45.540354 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 11:21:45.540354 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: from cryptography.utils import int_from_bytes Dec 15 11:21:45.541337 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 11:21:45.541337 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: from cryptography.utils import int_from_bytes Dec 15 11:21:45.541799 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 11:21:45.541799 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: from cryptography.utils import int_from_bytes Dec 15 11:21:48.174401 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 11:21:48.175076 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 11:21:48.175350 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 11:21:48.175540 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 11:21:48.175802 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 11:21:48.176198 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.176534 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.176871 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.177199 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.177535 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.177852 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.178792 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.179124 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.179952 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.179952 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.180115 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.180346 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813219-3-iscsi {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.180674 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.180995 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.181333 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.181642 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.181953 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.182283 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.182549 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 11:21:48.182920 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.183000 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 11:21:48.183121 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.183327 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 11:21:48.183564 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.183696 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 11:21:48.183879 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.183997 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 11:21:48.184201 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.184331 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.184551 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.184714 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.184933 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.185083 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.185256 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.185423 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.185589 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.185726 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.185903 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.186068 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.186234 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.186412 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.186599 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.186778 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.186959 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813219-3-iscsi {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.187098 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.187098 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.187433 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.187571 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.187750 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.187954 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813219-3-iscsi {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.188102 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.188275 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.188488 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.188646 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.188854 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.189038 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.189190 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.189348 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.189489 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.189642 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.189766 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.189919 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.190047 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.190175 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.190302 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.190302 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.190548 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.190716 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.190838 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.191049 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.191173 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.191298 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.191417 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.191687 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.191832 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.191983 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.192123 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.192242 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.192374 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.192501 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.192619 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.192800 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.192923 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.193041 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.193171 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.193356 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.193478 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.193694 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.193886 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813219-3-iscsi {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.194040 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.194168 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.194344 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.194491 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.194615 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.194845 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.194937 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.195181 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.195274 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.195508 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.195604 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.195825 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.195909 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.196142 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.196227 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.196456 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.196553 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.196770 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.196860 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.197084 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.197168 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.197397 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.197489 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.197711 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.197794 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.198024 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.198107 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.198330 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.198420 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.198669 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.198758 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.198985 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.199071 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.199300 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.199384 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.199606 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.199690 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.199916 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.200006 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.200170 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.200256 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.200484 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.200568 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.200818 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.200970 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.201141 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.201284 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.201465 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.201629 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.201780 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.202001 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.202141 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.202275 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.202409 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.202541 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.202726 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.202876 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.203016 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.203157 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.203300 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.203436 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.203582 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.203716 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.203854 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.203987 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.204118 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.204250 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.204392 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.204555 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.204689 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.204829 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.204991 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.205144 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.205316 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.205470 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.205638 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.205785 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.205962 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.206103 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.206276 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.206424 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.206621 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.206766 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.206941 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.207091 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.207262 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.207410 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.207576 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.207723 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.207888 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.208040 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.208200 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.208341 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.208514 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.208655 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.208826 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.208979 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.209164 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.209307 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.209472 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.209619 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.209785 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.209935 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.210099 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.210240 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.210412 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.210551 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.210740 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.210881 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.211059 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.211211 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.211358 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.211497 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.211630 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.211777 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.211916 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.212137 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.212277 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.212410 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.212555 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.212690 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.212822 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.212955 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.213107 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.213241 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.213409 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.213558 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.213722 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.213863 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.214037 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.214178 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.214351 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.214499 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.214700 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.214852 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.215018 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.215169 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.215331 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.215473 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.215647 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.215796 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.215960 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.216101 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.216309 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.216443 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.216577 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.216709 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.216870 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.217030 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.217166 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.217298 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.217479 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.217619 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.217787 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.217939 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.218100 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.218239 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.218426 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.218591 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.218765 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.218916 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.219066 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.219200 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.219378 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.219518 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.219699 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.219850 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.220013 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.220154 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.220337 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.220479 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.220660 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.220816 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.220975 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.221127 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.221300 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.221456 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.221604 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.221738 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.221910 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.222052 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.222285 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.222425 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.222593 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.222735 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.222925 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.223074 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.223217 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.223351 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.223532 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.223674 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.223846 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.223993 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.224158 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.224311 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.224454 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.224587 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.225293 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.225445 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.225636 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.225786 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.225960 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.226135 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.226276 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.226469 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.226640 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.226788 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.226930 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.227134 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.227274 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.227474 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.227622 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:21:48.227804 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.227952 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.228123 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.228264 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.228471 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.228612 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.228819 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.228959 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.229141 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.229307 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.229474 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.229866 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.230046 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.230197 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.230365 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.230511 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.230710 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.230844 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.231021 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.231163 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.231340 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.231493 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.231658 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.231808 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.231979 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.232131 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.232291 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.232497 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.232636 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.232782 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.232939 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.233078 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.233261 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.233407 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.233573 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.233725 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.233888 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.234029 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.234202 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.234343 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.234519 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.234703 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.234846 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.234986 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.235175 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.235316 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.235502 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.235651 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.235813 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.235953 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.236154 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.236304 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.236450 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.236584 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.236772 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.236912 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.237092 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.237232 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.237406 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.237546 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.237726 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.237874 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.238043 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.238199 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.238342 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.238475 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.238702 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.238845 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.239022 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.239244 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.239380 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.239511 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.239643 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.239776 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.239950 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.240099 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.240267 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.240522 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.241229 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.241454 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.241655 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.241814 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.241956 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.242089 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.242224 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.242364 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.242516 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.242791 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.242929 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.243074 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.243207 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.243349 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.243492 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.243626 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.243758 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.243901 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.244036 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.244169 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.244314 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.244454 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.244588 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.244736 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.244887 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.245021 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.245194 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.245336 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.245509 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.245650 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.245819 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.245960 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.246133 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.246274 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.246446 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.246616 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.246766 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.246914 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.247089 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.247228 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.247398 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.247544 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.247706 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.247857 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.248018 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.248158 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.248328 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.248468 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.248641 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.248799 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.248959 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.249098 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.249272 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.249419 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.249584 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.249733 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.249896 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.250037 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.250232 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.250373 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.250553 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.250733 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.250887 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.251020 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.251219 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.251361 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.251553 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.251696 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.251876 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.252017 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.252185 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.252325 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.252500 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.252647 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.252875 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.253027 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.253168 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.253308 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.253453 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.253587 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.253719 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.253852 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.253985 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.254117 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.254293 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.254442 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.254614 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.254765 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.254921 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.255073 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.255231 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.255371 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.255560 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.255709 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.255875 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.256077 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.256238 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.256441 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.256603 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.256739 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.256890 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.257034 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.257167 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.257300 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.257432 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.257565 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.257780 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.257931 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.258121 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.258269 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.258449 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.258656 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.258811 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.258955 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.259112 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.259253 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.259430 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.259575 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.259746 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.259892 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.260068 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.260208 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.260389 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.260531 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.260709 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.260851 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.261025 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.261165 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.261349 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.261495 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.261666 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.261806 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.261982 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.262121 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.262293 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.262440 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.262638 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.262792 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.263013 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.263163 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.263298 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.263443 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.263584 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.263718 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.263905 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.264052 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.264230 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.264398 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.264534 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.264674 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.264853 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.265012 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.265174 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.265323 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.265485 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.265631 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.265799 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.265938 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.266117 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.266263 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.266434 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.266630 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.266772 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.266904 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.267086 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.267241 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.267400 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.267540 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.267724 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.267864 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.268040 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.268179 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.268351 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.268491 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.268664 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.268805 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.269013 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.269157 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.269290 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.269423 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.269589 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.269730 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.269923 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.270064 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.270256 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.270397 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.270583 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.270742 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.270877 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.271016 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.271210 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.271352 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.271531 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.271755 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.271911 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.272045 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.272179 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.272319 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.272486 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.272641 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.272800 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.272973 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.273197 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.273354 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.273489 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.273633 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.273800 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.273942 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.274076 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.274208 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.274350 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.274527 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.274705 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.274874 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.275015 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.275193 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.275351 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.275509 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.275643 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.275825 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.275972 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.276147 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.276296 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.276462 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.276602 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.276785 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.276939 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.277107 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.277220 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.277413 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.277503 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.277723 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.277816 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.278050 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.278139 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.278365 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.278458 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.278697 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.278797 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.279014 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.279117 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.279320 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.279405 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.279637 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.279724 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.279964 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.280058 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.280270 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.280550 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.280635 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.280892 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.280991 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.281212 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.281297 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.281533 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.281633 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.281851 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.281960 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.282162 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.282256 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.282489 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.282590 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.282834 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.282929 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.283150 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.283275 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.283463 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.283548 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.283779 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.283865 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.284091 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.284185 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.284405 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.284491 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.284727 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.284814 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.285037 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.285121 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.285351 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.285457 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.285663 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.285749 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.285971 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.286058 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.286282 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.286379 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.286633 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.286724 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.287032 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.287209 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.287879 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.288135 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.288266 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.288544 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.288629 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.288875 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.288961 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.289190 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.289283 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.289518 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.289609 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.289832 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.289916 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.290144 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.290238 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.290458 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.290545 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.290799 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.290887 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.291138 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.291239 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.291454 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.291548 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.291763 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.291877 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.292082 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.292181 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.292392 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.292478 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.292703 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.292789 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.293014 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.293102 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.293331 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.293418 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.293642 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.293747 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.293953 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.294048 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.294261 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.294357 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.294605 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.294709 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.294917 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.295087 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.295225 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.295311 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.295542 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.295638 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.295848 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.295946 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.296164 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.296257 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.296479 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.296565 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.296787 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.296874 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.297093 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.297178 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.297403 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.297494 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.297725 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.297820 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.298042 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.298134 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.298354 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.298440 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.298691 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.298794 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.299014 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.299107 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.299329 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.299436 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.299640 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.299765 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.299957 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.300056 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.300268 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.300363 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.300576 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.300661 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.300886 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.300974 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.301194 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.301286 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.301504 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.301590 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.301810 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.301903 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.302128 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.302245 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.302440 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.302538 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.302776 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.302863 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.303675 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.303779 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.303991 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.304158 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.304304 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.304484 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.304620 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.304798 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.304933 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.305122 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.305246 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.305438 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.305553 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.305754 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.305880 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.306061 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.306204 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.306381 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.306499 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.306722 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.306844 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.307036 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.307157 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.307352 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.307471 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.307663 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.307782 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.307984 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.308098 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.308297 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.308410 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.308607 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.308720 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.308917 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.309030 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.309232 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.309343 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.309548 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.309646 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.309857 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.309971 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.310186 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.310274 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.310505 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.310648 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.310844 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.310931 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.311158 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.311246 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.311474 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.311561 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.311784 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.311879 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.312096 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.312205 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.312413 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.312512 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.312739 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.312841 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.313060 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.313147 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.313368 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.313455 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.313682 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.313777 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.313991 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.314085 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.314299 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.314386 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.314629 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.314752 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.314948 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.315035 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.315258 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.315344 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.315567 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.315656 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.315875 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.315961 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.316181 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.316267 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.316489 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.316577 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.316815 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.316904 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.317129 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.317216 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.317441 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.317528 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.317752 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.317846 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.318061 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.318147 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.318375 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.318460 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.318739 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.318936 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.319075 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.319314 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.319451 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.319632 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.319773 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.319955 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.320095 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.320284 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.320419 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.320607 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.320746 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.320930 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.321066 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.321251 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.321385 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.321568 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.321697 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.321891 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.322014 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.322212 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.322329 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.322536 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.322680 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.322869 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.322987 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.323179 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.323304 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.323506 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.323617 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.323825 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.323993 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.324145 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.324232 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.324472 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.324559 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.324801 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.324900 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.325129 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.325250 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.325438 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.325569 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.325752 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.325889 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.326071 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.326200 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.326387 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.326518 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.326727 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.326863 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.327043 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.327186 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.327362 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.327512 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.327685 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.327823 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.327998 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.328246 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.328341 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.328567 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.328662 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.328884 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.328972 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.329206 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.329294 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.329519 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.329617 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.329825 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.329910 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.330143 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.330227 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.330458 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.330555 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.330794 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.330881 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.331103 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.331189 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.331414 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.331501 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.331728 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.331813 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.332038 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.332126 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.332365 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.332459 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.332782 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.332878 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.333095 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.333180 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.333407 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.333495 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.333729 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.333815 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.334049 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.334139 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.334396 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.334678 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.334782 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.335016 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.335103 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.335346 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.335441 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.335676 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.335762 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.335990 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.336090 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.336313 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.336401 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.336629 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.336717 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.336956 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.337040 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.337275 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.337363 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.337595 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.337696 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.337906 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.338005 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.338215 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.338305 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.338521 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.338639 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.338874 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.338977 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.339184 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.339273 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.339509 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.339606 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.339926 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.340028 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.340264 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.340356 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.340551 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.340640 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.340884 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.340982 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.341216 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.341306 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.341530 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.341626 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.341842 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.341938 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.342157 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.342246 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.342469 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.342559 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.342809 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.342900 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.343140 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.343229 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.343452 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.343548 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.343773 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.343872 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.344096 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.344208 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.344413 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.344501 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.344722 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.344809 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.345033 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.345122 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.345361 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.345448 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.345669 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.345755 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.345995 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.346082 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.346312 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.346401 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.346662 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.346753 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.346995 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.347085 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.347308 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.347396 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.347637 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.347747 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.347957 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.348063 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.348267 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.348353 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.348579 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.348675 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.348890 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.348977 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.349201 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.349287 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.349516 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.349613 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.350378 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.350495 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.350716 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.350866 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.351040 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.351229 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.351362 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.351551 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.351678 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.351897 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.351993 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.352235 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.352323 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.352562 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.352656 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.352892 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.353004 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.353216 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.353302 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.353529 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.353615 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.353842 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.353938 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.354162 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.354256 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.354470 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.354840 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.355063 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.355163 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.355378 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.355465 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.355686 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.355779 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.355996 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.356082 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.356305 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.356390 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.356616 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.356701 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.356947 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.357035 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.357262 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.357348 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.357593 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.357678 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.357910 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.358011 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.358228 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.358325 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.358542 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.358645 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.358886 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.358982 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.359209 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.359295 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.359533 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.359629 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.359864 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.359950 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.360175 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.360261 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.360487 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.360581 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.360801 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.360887 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.361111 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.361197 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.361424 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.361520 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.361736 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.361823 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.362055 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.362141 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.362364 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.362456 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.362697 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.362788 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.363011 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.363110 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.363336 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.363433 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.363647 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.363734 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.363962 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.364047 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.364277 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.364374 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.364586 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.364673 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.364898 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.364986 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.365207 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.365514 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.366184 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.366413 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.366598 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.366769 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.366954 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.367097 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.367285 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.367420 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.367617 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.367747 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.367955 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.368072 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.368281 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.368390 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.368615 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.368719 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.368942 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.369041 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.369266 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.369357 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.369593 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.369694 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.369916 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.370006 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.370239 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.370330 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.370586 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.370689 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.370912 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.371002 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.371232 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.371321 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.371557 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.371647 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.371877 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.371966 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.372200 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.372290 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.372553 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.372730 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.372869 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.373070 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.373195 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.373391 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.373518 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.373713 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.373837 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.374034 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.374148 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.374358 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.374453 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.374702 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.374793 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.375023 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.375121 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.375343 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.375509 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.375662 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.375750 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.375979 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.376082 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.376313 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.376399 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.376638 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.376724 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.376968 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.377064 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.377293 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.377378 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.377615 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.377701 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.377934 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.378033 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.378252 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.378350 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.378614 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.378805 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.378962 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.379133 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.379273 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.379477 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.379587 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.379816 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.379912 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.380152 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.380246 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.380479 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.380565 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.380808 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.380903 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.381174 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.381260 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.381492 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.381586 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.381807 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.381916 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.382128 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.382236 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.382446 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.382553 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.382783 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.382905 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.383117 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.383224 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.383438 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.383531 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.383750 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.383870 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.384075 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.384196 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.384393 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.384535 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.384825 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.384924 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.385149 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.385272 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.385595 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.385689 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.385930 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.386017 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.386263 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.386349 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.386612 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.386719 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.386923 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.387012 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.387251 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.387337 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.387565 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.387653 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.387878 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.387971 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.388192 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.388278 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.388504 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.388605 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.388814 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.388899 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.389124 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.389211 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.389430 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.389517 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.389744 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.389829 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.390056 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.390149 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.390364 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.390450 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.390696 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.390804 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.391017 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.391116 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.391366 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.391553 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.391648 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.391910 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.392010 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.392233 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.392322 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.392550 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.392636 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.392861 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.392947 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.393175 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.393329 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.393484 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.393570 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.393800 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.393885 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.394109 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.394202 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.394418 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.394505 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.394752 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.395022 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.395120 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.395200 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.395370 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.395466 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.395681 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.395782 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.395988 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.396075 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.396299 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.396399 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.396611 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.397228 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.397436 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.397542 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.397744 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.397842 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.398065 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.398162 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.398395 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.398484 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.398741 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.398843 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.399052 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.399140 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.399371 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.399459 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.399711 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.399843 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.400250 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.400343 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.400636 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.400804 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.400965 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.401287 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.401386 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.401659 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.401778 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.401976 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.402263 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.402350 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.402604 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.402780 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.402939 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.403259 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.403347 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.403576 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.403889 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.403989 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.404206 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.404447 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.404545 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.404828 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.404924 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.405144 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.405240 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.405462 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.405560 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.405781 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.405869 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.406103 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.406239 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.406449 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.406805 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.406906 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.407132 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.407281 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.407525 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.407622 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.407855 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.407944 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.408173 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.408260 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.408490 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.408600 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.408808 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.408931 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.409124 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.409447 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.409539 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.409785 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.409886 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.410182 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.410536 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.410916 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.411236 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.411374 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.411554 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.411707 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.411869 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.412152 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.412252 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.413040 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.413179 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.413380 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.413699 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.413799 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.414029 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.414356 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.414709 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.415036 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.415358 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.415682 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.415768 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.416005 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.416095 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.416333 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.416454 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.416683 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.416853 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.417076 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.417227 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.417384 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.417557 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.417643 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.417787 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.417955 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.418150 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.418275 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.418499 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.418619 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.418868 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.419011 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.419192 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.419292 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.419514 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.419610 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.419835 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.420020 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.420159 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.420507 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.420602 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.420856 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.421058 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.421184 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.421520 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.421747 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.421835 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.422165 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.422252 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.422487 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.422820 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.422924 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.423168 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.423347 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.423498 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.423820 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.423909 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.424162 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.424258 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.424534 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.424634 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.424818 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.424902 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.425142 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.425242 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.425467 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.425554 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.425788 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.425876 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.426111 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.426300 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.426445 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.426805 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.426896 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.427125 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.427278 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.427460 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.427587 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.427788 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.427932 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.428197 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.428361 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.428648 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.428735 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.428978 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.429111 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.429318 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.429453 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.429644 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.429950 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.430038 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.430284 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.430414 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.430629 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.430775 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.430963 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.431116 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.431291 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.431478 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.431628 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.431818 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.431967 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.432162 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.432302 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.432574 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.432662 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.432982 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.433069 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.433309 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.433549 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.433662 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.433881 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.434000 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.434215 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.434325 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.434545 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.434682 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.434895 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.434983 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.435214 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 11:21:48.435315 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.435534 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.435873 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.436211 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.436530 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.436867 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.437196 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.437529 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.437854 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.438176 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.438515 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.438864 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.439190 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.439510 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.439834 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.440160 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.440485 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.440821 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.441157 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.441492 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.441828 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.442186 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.442511 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.442886 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.443224 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.443565 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.443925 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.444238 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:21:48.444485 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 11:21:48.457573 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_db.sqlalchemy.engines [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:21:48.467594 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG oslo_db.sqlalchemy.engines [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:21:48.525383 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.context [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2ae07d7-a922-431d-b06a-73b88198aa10(cell1) {{(pid=101693) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 11:21:48.529604 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:21:48.531230 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:21:48.532030 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:21:48.533375 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.context [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2ae07d7-a922-431d-b06a-73b88198aa10(cell1) {{(pid=101692) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 11:21:48.533976 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:21:48.538252 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG oslo_concurrency.lockutils [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:21:48.539940 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG oslo_concurrency.lockutils [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:21:48.540749 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG oslo_concurrency.lockutils [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:21:48.542718 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG oslo_concurrency.lockutils [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:21:48.547108 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_db.sqlalchemy.engines [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:21:48.549558 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_db.sqlalchemy.engines [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:21:48.556537 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG oslo_db.sqlalchemy.engines [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:21:48.558786 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG oslo_db.sqlalchemy.engines [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:21:48.715181 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_db.sqlalchemy.engines [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:21:48.727925 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG oslo_db.sqlalchemy.engines [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:21:49.066944 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: WARNING keystonemiddleware.auth_token [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 11:21:49.071357 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: WARNING keystonemiddleware.auth_token [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 11:21:49.074122 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: WARNING keystonemiddleware.auth_token [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 11:21:49.079811 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: WARNING keystonemiddleware.auth_token [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 11:21:49.418464 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: WARNING keystonemiddleware.auth_token [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 11:21:49.423878 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: WARNING keystonemiddleware.auth_token [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 11:21:49.429859 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5648780269c0 pid: 101692 (default app) Dec 15 11:21:49.432325 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:21:49.433663 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002216 Dec 15 11:21:49.434080 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Dec 15 11:21:49 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:21:49.438454 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: WARNING keystonemiddleware.auth_token [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 11:21:49.444462 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: WARNING keystonemiddleware.auth_token [None req-af1d12e6-c7bb-4b4e-bb0a-1162de2d7a3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 11:21:49.449676 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5648780269c0 pid: 101693 (default app) Dec 15 11:23:12.047930 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:12.048954 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Dec 15 11:23:12.049355 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:12.492135 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-cfc00180-8b95-4ed9-999d-09712ec185c0 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:12.520786 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-cfc00180-8b95-4ed9-999d-09712ec185c0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.464085 Dec 15 11:23:12.521672 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Dec 15 11:23:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:23:14.963955 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:14.964878 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-36d9f217-6d94-4a31-8c83-ae7d2e06c2e8 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Dec 15 11:23:14.965332 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:15.032538 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-4dca618c-1edf-4bbd-9f0e-30c698b69361 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:15.057005 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:23:15.057005 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: warnings.warn(msg) Dec 15 11:23:15.087699 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-4dca618c-1edf-4bbd-9f0e-30c698b69361 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115880 Dec 15 11:23:15.094643 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 11:23:14 2021] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:23:15.321583 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-8095c141-7691-4259-a798-f3211a077f77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:15.324068 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:23:15.324068 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: warnings.warn(msg) Dec 15 11:23:15.380006 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-8095c141-7691-4259-a798-f3211a077f77 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281981 Dec 15 11:23:15.382617 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Dec 15 11:23:15 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:23:17.801573 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-4dca618c-1edf-4bbd-9f0e-30c698b69361 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:17.802629 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-4dca618c-1edf-4bbd-9f0e-30c698b69361 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Dec 15 11:23:17.803176 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:17.916996 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-0d3fe269-1341-4b68-878f-b370aaae9cd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:17.938607 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:23:17.938607 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: warnings.warn(msg) Dec 15 11:23:17.962335 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-0d3fe269-1341-4b68-878f-b370aaae9cd3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152489 Dec 15 11:23:17.963249 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 11:23:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:23:17.976024 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-cb3beb83-5908-4c96-a5c0-45762307a079 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:17.977507 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:23:17.977507 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: warnings.warn(msg) Dec 15 11:23:18.019090 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-cb3beb83-5908-4c96-a5c0-45762307a079 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046638 Dec 15 11:23:18.019809 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Dec 15 11:23:17 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:23:20.431665 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-0d3fe269-1341-4b68-878f-b370aaae9cd3 admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:20.431665 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-0d3fe269-1341-4b68-878f-b370aaae9cd3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001709 Dec 15 11:23:20.431665 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:20.493437 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-9e0060ed-ac43-4956-a07e-3d5f8c442580 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:20.512893 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-9e0060ed-ac43-4956-a07e-3d5f8c442580 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073967 Dec 15 11:23:20.513585 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 11:23:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:23:20.525650 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-dbbbaed0-55a8-4054-87db-66e93e05c782 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:20.549324 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-dbbbaed0-55a8-4054-87db-66e93e05c782 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027232 Dec 15 11:23:20.549897 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Dec 15 11:23:20 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:23:22.997814 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-9e0060ed-ac43-4956-a07e-3d5f8c442580 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:22.999186 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-9e0060ed-ac43-4956-a07e-3d5f8c442580 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001956 Dec 15 11:23:22.999528 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:23.069992 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-690f216a-2fa2-4654-a245-207c9b20eaa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:23.087464 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-690f216a-2fa2-4654-a245-207c9b20eaa6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078764 Dec 15 11:23:23.088049 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 11:23:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:23:23.100709 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-133320ac-29de-454e-80f3-75145f01e79d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:23.124386 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-133320ac-29de-454e-80f3-75145f01e79d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027193 Dec 15 11:23:23.124975 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Dec 15 11:23:23 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:23:25.555283 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-690f216a-2fa2-4654-a245-207c9b20eaa6 admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:25.556975 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-690f216a-2fa2-4654-a245-207c9b20eaa6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Dec 15 11:23:25.557505 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:25.621963 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-3984729e-81eb-47d9-914f-02b6424cf664 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "name": "ds4G", "swap": 0}} {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:25.641297 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-3984729e-81eb-47d9-914f-02b6424cf664 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076952 Dec 15 11:23:25.641853 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 11:23:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:23:25.654620 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-0d4270d7-310e-40b3-aa24-17489ae031dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:25.679487 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-0d4270d7-310e-40b3-aa24-17489ae031dd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029079 Dec 15 11:23:25.680058 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Dec 15 11:23:25 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:23:28.165458 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-3984729e-81eb-47d9-914f-02b6424cf664 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:28.166471 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-3984729e-81eb-47d9-914f-02b6424cf664 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Dec 15 11:23:28.167198 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:28.235685 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-c8241685-3624-4133-80a3-764bc058e595 admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:28.267043 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-c8241685-3624-4133-80a3-764bc058e595 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.092502 Dec 15 11:23:28.267760 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Dec 15 11:23:28 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:23:30.750222 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-3984729e-81eb-47d9-914f-02b6424cf664 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:30.752198 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-3984729e-81eb-47d9-914f-02b6424cf664 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002268 Dec 15 11:23:30.752763 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:30 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:30.822314 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-eafec327-f17b-4bde-a649-a2d15d94d87f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "id": "1", "swap": 0}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:30.840694 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-eafec327-f17b-4bde-a649-a2d15d94d87f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081405 Dec 15 11:23:30.841268 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 11:23:30 2021] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:23:30.856702 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-bce8924d-5408-43d5-b89f-0dc279f22e81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:30.884817 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-bce8924d-5408-43d5-b89f-0dc279f22e81 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034374 Dec 15 11:23:30.885537 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Dec 15 11:23:30 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:23:33.781117 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-eafec327-f17b-4bde-a649-a2d15d94d87f admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:33.782188 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-eafec327-f17b-4bde-a649-a2d15d94d87f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Dec 15 11:23:33.782624 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:33.839676 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-aba8cfeb-522d-404c-bfcf-e051adabfa61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "id": "2", "vcpus": 1, "name": "m1.small"}} {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:33.857153 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-aba8cfeb-522d-404c-bfcf-e051adabfa61 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068396 Dec 15 11:23:33.857667 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 11:23:33 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:23:33.869883 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-1bb7aef6-8b6f-46d0-baa5-1592806a5e87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:33.892206 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-1bb7aef6-8b6f-46d0-baa5-1592806a5e87 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025970 Dec 15 11:23:33.892865 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Dec 15 11:23:33 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:23:36.317613 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-aba8cfeb-522d-404c-bfcf-e051adabfa61 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:36.318730 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-aba8cfeb-522d-404c-bfcf-e051adabfa61 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Dec 15 11:23:36.319169 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:36.383339 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-fc2ce6d9-f174-4948-8e23-7fecfba6a804 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "ram": 4096, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:36.401928 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-fc2ce6d9-f174-4948-8e23-7fecfba6a804 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076189 Dec 15 11:23:36.402489 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 11:23:36 2021] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:23:36.415111 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-22d6c5cc-3709-4579-a902-91e1006ac167 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:36.439432 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-22d6c5cc-3709-4579-a902-91e1006ac167 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027961 Dec 15 11:23:36.439942 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Dec 15 11:23:36 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:23:39.007892 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-fc2ce6d9-f174-4948-8e23-7fecfba6a804 admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:39.009567 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-fc2ce6d9-f174-4948-8e23-7fecfba6a804 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Dec 15 11:23:39.009975 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:39.072963 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-af592ff4-791a-4b55-843e-fe1aa6e289db admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:39.093137 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-af592ff4-791a-4b55-843e-fe1aa6e289db admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075669 Dec 15 11:23:39.094353 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 11:23:39 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:23:39.106251 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-ee856811-c63a-42de-81c7-27f9f74271fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:39.130427 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-ee856811-c63a-42de-81c7-27f9f74271fa admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027728 Dec 15 11:23:39.131044 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Dec 15 11:23:39 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:23:41.801997 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-af592ff4-791a-4b55-843e-fe1aa6e289db admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:23:41.803042 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-af592ff4-791a-4b55-843e-fe1aa6e289db admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Dec 15 11:23:41.804764 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:23:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:23:41.868942 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-88b481f9-014e-4d2d-ba8d-b14ce2b53aea admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "swap": 0, "ram": 16384, "id": "5"}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:41.886775 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-88b481f9-014e-4d2d-ba8d-b14ce2b53aea admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076555 Dec 15 11:23:41.887560 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 11:23:41 2021] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:23:41.900133 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-c72195f4-1a7a-4ee3-b9af-9445b3ec8b92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:23:41.925117 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-c72195f4-1a7a-4ee3-b9af-9445b3ec8b92 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028536 Dec 15 11:23:41.926040 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Dec 15 11:23:41 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:24:02.902530 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-88b481f9-014e-4d2d-ba8d-b14ce2b53aea admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:02.903570 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-88b481f9-014e-4d2d-ba8d-b14ce2b53aea admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Dec 15 11:24:02.903967 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:24:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:24:02.962350 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-caed5fec-caed-44b4-847e-a788ac20b844 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:02.978845 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-caed5fec-caed-44b4-847e-a788ac20b844 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068022 Dec 15 11:24:02.979374 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Dec 15 11:24:02 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:24:04.568452 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-88b481f9-014e-4d2d-ba8d-b14ce2b53aea admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:04.569453 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-88b481f9-014e-4d2d-ba8d-b14ce2b53aea admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Dec 15 11:24:04.569848 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:24:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:24:04.757710 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-1264c05a-a4f6-47b0-b5d5-180013fafcbd admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:04.763169 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.wsgi [None req-1264c05a-a4f6-47b0-b5d5-180013fafcbd admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 11:24:04.763738 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-1264c05a-a4f6-47b0-b5d5-180013fafcbd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:24:04.764529 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-1264c05a-a4f6-47b0-b5d5-180013fafcbd admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057570 Dec 15 11:24:04.765031 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Dec 15 11:24:04 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 11:24:04.774814 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-f3688e40-e8c5-4dde-b6fb-bc2bcc9e0f44 admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:04.794906 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-f3688e40-e8c5-4dde-b6fb-bc2bcc9e0f44 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023501 Dec 15 11:24:04.795379 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 11:24:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:24:04.806206 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-384d5650-233c-4a70-8065-54209c2ae4cc admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:04.827907 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-384d5650-233c-4a70-8065-54209c2ae4cc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025241 Dec 15 11:24:04.828438 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 11:24:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:24:04.838292 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-bed141f8-17bc-4c80-aefb-bc6c9859d14a admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:04.843608 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.wsgi [None req-bed141f8-17bc-4c80-aefb-bc6c9859d14a admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 11:24:04.844166 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-bed141f8-17bc-4c80-aefb-bc6c9859d14a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:24:04.844941 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-bed141f8-17bc-4c80-aefb-bc6c9859d14a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010178 Dec 15 11:24:04.845952 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Dec 15 11:24:04 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 11:24:06.369922 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-384d5650-233c-4a70-8065-54209c2ae4cc admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:06.371009 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-384d5650-233c-4a70-8065-54209c2ae4cc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Dec 15 11:24:06.371404 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:24:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:24:06.563051 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-70792b58-e45b-411c-90b1-7baddb8f0bca admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:06.568718 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.wsgi [None req-70792b58-e45b-411c-90b1-7baddb8f0bca admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 11:24:06.569285 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-70792b58-e45b-411c-90b1-7baddb8f0bca admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:24:06.570069 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-70792b58-e45b-411c-90b1-7baddb8f0bca admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058068 Dec 15 11:24:06.570590 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Dec 15 11:24:06 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 11:24:06.580201 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-ca5555d8-eee6-46df-a53e-16b681e0fa29 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:06.594686 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-ca5555d8-eee6-46df-a53e-16b681e0fa29 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018033 Dec 15 11:24:06.595203 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 11:24:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:24:06.605452 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-3ff17141-28ee-46ba-9310-de2bde5c2b41 admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:06.619385 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-3ff17141-28ee-46ba-9310-de2bde5c2b41 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017330 Dec 15 11:24:06.619908 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 11:24:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:24:06.629398 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-d70b8328-ac6c-4622-8075-02b6e3dda519 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:06.634440 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.wsgi [None req-d70b8328-ac6c-4622-8075-02b6e3dda519 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 11:24:06.635034 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-d70b8328-ac6c-4622-8075-02b6e3dda519 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:24:06.635808 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-d70b8328-ac6c-4622-8075-02b6e3dda519 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010058 Dec 15 11:24:06.636287 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Dec 15 11:24:06 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 15 11:24:08.116798 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-3ff17141-28ee-46ba-9310-de2bde5c2b41 admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:08.117795 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-3ff17141-28ee-46ba-9310-de2bde5c2b41 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Dec 15 11:24:08.118212 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:24:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:24:08.312134 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-8575c5b3-f34a-4671-87a9-faef6916b663 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:08.317402 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.wsgi [None req-8575c5b3-f34a-4671-87a9-faef6916b663 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 11:24:08.317966 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-8575c5b3-f34a-4671-87a9-faef6916b663 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:24:08.318789 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-8575c5b3-f34a-4671-87a9-faef6916b663 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058058 Dec 15 11:24:08.319295 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 11:24:08 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 11:24:08.329012 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-4d1a62ce-cfce-49a0-afff-5d8737867eb5 admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:08.346395 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-4d1a62ce-cfce-49a0-afff-5d8737867eb5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020285 Dec 15 11:24:08.348856 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 11:24:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:24:08.358302 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:08.371452 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017059 Dec 15 11:24:08.371976 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 11:24:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:24:08.382030 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-7d577abf-e00a-4a5d-b501-ba3e31dc953e admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:08.387291 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.wsgi [None req-7d577abf-e00a-4a5d-b501-ba3e31dc953e admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 11:24:08.387843 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-7d577abf-e00a-4a5d-b501-ba3e31dc953e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:24:08.388609 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-7d577abf-e00a-4a5d-b501-ba3e31dc953e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010149 Dec 15 11:24:08.389089 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 11:24:08 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 11:24:09.888971 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:09.890007 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Dec 15 11:24:09.890401 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:24:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:24:10.085063 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-d1bc7fbd-54af-4a9c-9311-135395b58416 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:24:10.104626 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-d1bc7fbd-54af-4a9c-9311-135395b58416 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074569 Dec 15 11:24:10.105162 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Dec 15 11:24:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:24:11.591532 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:11.592535 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Dec 15 11:24:11.592936 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:24:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:24:11.782674 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-85ac7788-59cc-4d54-ab4b-dbeadad073f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:24:11.800403 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-85ac7788-59cc-4d54-ab4b-dbeadad073f4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069107 Dec 15 11:24:11.800890 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Dec 15 11:24:11 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:24:13.304583 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:13.305583 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Dec 15 11:24:13.305978 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:24:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:24:13.504265 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-9b7def82-0f9f-493c-ac3b-872afe3c615c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:24:13.522392 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-9b7def82-0f9f-493c-ac3b-872afe3c615c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075092 Dec 15 11:24:13.522898 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Dec 15 11:24:13 2021] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:24:15.013479 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:15.014486 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Dec 15 11:24:15.014919 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:24:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:24:15.207171 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-80d9198e-adf2-49db-9d6b-12fefb60ad91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:24:15.224406 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-80d9198e-adf2-49db-9d6b-12fefb60ad91 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069521 Dec 15 11:24:15.224883 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Dec 15 11:24:15 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:24:16.707042 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:16.708157 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002398 Dec 15 11:24:16.708558 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:24:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:24:16.896776 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-42ccb4ca-1baa-411e-92fb-ce368d2dfa8e admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:24:16.915538 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-42ccb4ca-1baa-411e-92fb-ce368d2dfa8e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069368 Dec 15 11:24:16.915997 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Dec 15 11:24:16 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:25:04.690945 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:25:04.691942 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-263c6936-e596-4da8-a02e-c30f83ce1c9e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 15 11:25:04.692338 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 11:25:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:25:04.750837 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-6c6ef628-2e5a-42de-b735-c66177a085d9 admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:25:04.769417 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-6c6ef628-2e5a-42de-b735-c66177a085d9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070609 Dec 15 11:25:04.769948 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Dec 15 11:25:04 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:25:04.792756 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-f98b2fea-0ba1-4afd-a843-12ad203b29f2 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:25:04.800334 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-f98b2fea-0ba1-4afd-a843-12ad203b29f2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011127 Dec 15 11:25:04.800843 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Dec 15 11:25:04 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:25:04.812911 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-20169f2d-7aa8-4650-94a6-f5c283d01227 admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:25:04.820988 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-20169f2d-7aa8-4650-94a6-f5c283d01227 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011461 Dec 15 11:25:04.821497 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Dec 15 11:25:04 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:25:04.832657 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-a005c3d2-0619-4e68-9462-ae97f63d12db admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:25:04.840646 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-a005c3d2-0619-4e68-9462-ae97f63d12db admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011408 Dec 15 11:25:04.841149 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Dec 15 11:25:04 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:25:04.852236 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-b6412509-a69f-4621-aff6-8556306f617d admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:25:04.859449 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-b6412509-a69f-4621-aff6-8556306f617d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010597 Dec 15 11:25:04.859955 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Dec 15 11:25:04 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:26:28.968633 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-68dbef1e-8930-49aa-8d28-a4024b3363fa tempest-verify_tempest_config-498620435 tempest-verify_tempest_config-498620435-project] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:26:28.970695 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-68dbef1e-8930-49aa-8d28-a4024b3363fa tempest-verify_tempest_config-498620435 tempest-verify_tempest_config-498620435-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105510 Dec 15 11:26:28.971225 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 34/69] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Dec 15 11:26:28 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:27:54.324104 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-b6412509-a69f-4621-aff6-8556306f617d admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:27:54.325740 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-b6412509-a69f-4621-aff6-8556306f617d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002191 Dec 15 11:27:54.326249 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 36/70] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:27:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:27:54.579120 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-d563cc03-ae76-49e5-8d3b-944f374d059a admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:27:54.580264 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:27:54.580264 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: warnings.warn(msg) Dec 15 11:27:54.581795 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-d563cc03-ae76-49e5-8d3b-944f374d059a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:27:54.582290 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-d563cc03-ae76-49e5-8d3b-944f374d059a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:27:54.583104 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-d563cc03-ae76-49e5-8d3b-944f374d059a admin admin] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:27:54.583528 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-d563cc03-ae76-49e5-8d3b-944f374d059a admin admin] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:27:54.616867 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-d563cc03-ae76-49e5-8d3b-944f374d059a admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.145142 Dec 15 11:27:54.617976 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 35/71] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 11:27:54 2021] GET /compute/v2.1/os-services => generated 791 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:27:56.131529 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-b6412509-a69f-4621-aff6-8556306f617d admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:27:56.132531 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-b6412509-a69f-4621-aff6-8556306f617d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Dec 15 11:27:56.132925 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 37/72] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:27:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:27:56.327750 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-9f1a2b0b-b9e5-4cfd-a221-30f950ade218 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:27:56.328905 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:27:56.328905 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: warnings.warn(msg) Dec 15 11:27:56.330560 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-9f1a2b0b-b9e5-4cfd-a221-30f950ade218 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:27:56.330850 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-9f1a2b0b-b9e5-4cfd-a221-30f950ade218 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:27:56.332189 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-9f1a2b0b-b9e5-4cfd-a221-30f950ade218 admin admin] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:27:56.332725 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-9f1a2b0b-b9e5-4cfd-a221-30f950ade218 admin admin] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:27:56.352463 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-9f1a2b0b-b9e5-4cfd-a221-30f950ade218 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077243 Dec 15 11:27:56.353219 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 36/73] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 11:27:56 2021] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:28:08.269492 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-b6412509-a69f-4621-aff6-8556306f617d admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:28:08.270488 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-b6412509-a69f-4621-aff6-8556306f617d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Dec 15 11:28:08.270919 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 38/74] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:28:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:28:08.461515 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-fa1e92b6-c83b-4efb-9c79-955689cd8b26 admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:28:08.462707 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:28:08.462707 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: warnings.warn(msg) Dec 15 11:28:08.464256 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-fa1e92b6-c83b-4efb-9c79-955689cd8b26 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:28:08.464703 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-fa1e92b6-c83b-4efb-9c79-955689cd8b26 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:28:08.465504 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-fa1e92b6-c83b-4efb-9c79-955689cd8b26 admin admin] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:28:08.465935 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-fa1e92b6-c83b-4efb-9c79-955689cd8b26 admin admin] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:28:08.492401 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-fa1e92b6-c83b-4efb-9c79-955689cd8b26 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081522 Dec 15 11:28:08.492960 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 37/75] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 11:28:08 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:28:09.987331 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: DEBUG nova.api.openstack.wsgi [None req-b6412509-a69f-4621-aff6-8556306f617d admin admin] Calling method '>' {{(pid=101692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:28:09.988380 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: INFO nova.api.openstack.requestlog [None req-b6412509-a69f-4621-aff6-8556306f617d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001841 Dec 15 11:28:09.988778 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: [pid: 101692|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 11:28:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:28:10.183708 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG nova.api.openstack.wsgi [None req-e6d161f5-a2f2-4421-aee6-34e792f12a6e admin admin] Calling method '>' {{(pid=101693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:28:10.184885 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:28:10.184885 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: warnings.warn(msg) Dec 15 11:28:10.186439 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-e6d161f5-a2f2-4421-aee6-34e792f12a6e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:28:10.186913 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-e6d161f5-a2f2-4421-aee6-34e792f12a6e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:28:10.187991 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-e6d161f5-a2f2-4421-aee6-34e792f12a6e admin admin] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:28:10.188447 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: DEBUG oslo_concurrency.lockutils [None req-e6d161f5-a2f2-4421-aee6-34e792f12a6e admin admin] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:28:10.210904 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: INFO nova.api.openstack.requestlog [None req-e6d161f5-a2f2-4421-aee6-34e792f12a6e admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078696 Dec 15 11:28:10.211445 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: [pid: 101693|app: 0|req: 38/77] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 11:28:10 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:29:06.108151 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: Wed Dec 15 11:29:06 2021 - graceful shutdown triggered... Dec 15 11:29:06.113272 dv-cinder-813219-3-iscsi devstack@n-api.service[101692]: Gracefully killing worker 1 (pid: 101692)... Dec 15 11:29:06.108267 dv-cinder-813219-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 11:29:06.114255 dv-cinder-813219-3-iscsi devstack@n-api.service[101693]: Gracefully killing worker 2 (pid: 101693)... Dec 15 11:29:07.109310 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: worker 1 buried after 1 seconds Dec 15 11:29:07.109873 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: worker 2 buried after 1 seconds Dec 15 11:29:07.109873 dv-cinder-813219-3-iscsi devstack@n-api.service[101691]: goodbye to uWSGI. Dec 15 11:29:07.110958 dv-cinder-813219-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 11:29:07.111504 dv-cinder-813219-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 11:29:07.114286 dv-cinder-813219-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 11:29:07.124277 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 11:29:07.126289 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 11:29:07 2021] *** Dec 15 11:29:07.126289 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 11:29:07.126289 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 11:29:07.126289 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: nodename: dv-cinder-813219-3-iscsi Dec 15 11:29:07.126289 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: machine: x86_64 Dec 15 11:29:07.126289 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: clock source: unix Dec 15 11:29:07.126289 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: pcre jit disabled Dec 15 11:29:07.126289 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: detected number of CPU cores: 4 Dec 15 11:29:07.126289 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: current working directory: / Dec 15 11:29:07.126289 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: detected binary path: /usr/bin/uwsgi-core Dec 15 11:29:07.126981 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: your processes number limit is 47680 Dec 15 11:29:07.126981 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: your memory page size is 4096 bytes Dec 15 11:29:07.126981 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: detected max file descriptor number: 2048 Dec 15 11:29:07.126981 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: lock engine: pthread robust mutexes Dec 15 11:29:07.126981 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: thunder lock: enabled Dec 15 11:29:07.126981 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 11:29:07.126981 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 11:29:07.172512 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: Python main interpreter initialized at 0x55723818e9c0 Dec 15 11:29:07.172512 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: python threads support enabled Dec 15 11:29:07.172512 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: your server socket listen backlog is limited to 100 connections Dec 15 11:29:07.172512 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: your mercy for graceful operations on workers is 90 seconds Dec 15 11:29:07.172933 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 11:29:07.172933 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: *** Operational MODE: preforking *** Dec 15 11:29:07.173278 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: *** uWSGI is running in multiple interpreter mode *** Dec 15 11:29:07.173278 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: spawned uWSGI master process (pid: 116061) Dec 15 11:29:07.173484 dv-cinder-813219-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 11:29:07.174643 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: spawned uWSGI worker 1 (pid: 116082, cores: 1) Dec 15 11:29:07.178350 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: spawned uWSGI worker 2 (pid: 116083, cores: 1) Dec 15 11:29:07.178659 dv-cinder-813219-3-iscsi devstack@n-api.service[116061]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 11:29:09.080990 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 11:29:09.080990 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: from cryptography.utils import int_from_bytes Dec 15 11:29:09.081696 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 11:29:09.081696 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: from cryptography.utils import int_from_bytes Dec 15 11:29:09.097562 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 11:29:09.097562 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: from cryptography.utils import int_from_bytes Dec 15 11:29:09.098177 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 11:29:09.098177 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: from cryptography.utils import int_from_bytes Dec 15 11:29:11.508102 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 11:29:11.508794 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 11:29:11.508886 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 11:29:11.509200 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 11:29:11.509462 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 11:29:11.509852 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.510175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.510498 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.510841 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.511179 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.511491 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.511812 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.512131 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.512490 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.512829 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.513163 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.513482 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813219-3-iscsi {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.513808 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.514120 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.514430 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.514774 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.515086 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.515408 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.515721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.516219 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.517621 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.517621 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.517621 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.517889 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.518179 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.518512 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.518866 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.519176 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.519491 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.519821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.520217 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813219-3-iscsi {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.520533 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.520842 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.521149 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.521565 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.521876 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.522196 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.522511 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.522868 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.523178 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.523510 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.523838 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.524163 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.524488 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.524796 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.525106 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.525419 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.525757 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.526059 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.526367 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.526643 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.526957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.527284 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.527608 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.527936 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.528733 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.528990 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.529317 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.529642 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.529954 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.530264 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.530586 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.530908 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.531218 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.531527 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.531835 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.532145 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.532469 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.532787 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.533110 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.533419 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.533745 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.534152 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.534414 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.534746 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.535097 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.535432 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.535741 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.536067 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.536395 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.536705 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.537015 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.537324 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.537650 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.537993 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.538301 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.538556 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.538881 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.539189 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.539511 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.539820 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.540132 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.540439 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.540746 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.541052 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.541363 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.541672 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.541980 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.542290 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.542617 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.542929 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.543237 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.543544 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.544606 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.545100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.545419 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.545734 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.546054 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.546354 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.546719 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.547029 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.547340 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.547665 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.547976 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.548284 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.548607 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.548918 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.549237 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.549556 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.549861 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.550170 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.550498 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.550836 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.551148 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.551453 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.551761 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.552066 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.552372 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.552675 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.552984 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.553288 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.553550 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 11:29:11.554115 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.557064 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 11:29:11.557253 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.557253 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.557572 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 11:29:11.557733 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.557890 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 11:29:11.558034 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.558188 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 11:29:11.558339 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.558490 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.558685 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.558852 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.559003 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.559153 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.559344 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.559507 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.559507 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.559791 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.559933 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.560232 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.560379 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.560556 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.560700 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.560867 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.561039 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.561188 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.561346 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.561495 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.561648 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.561797 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.561945 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813219-3-iscsi {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.562094 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.562247 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.562390 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.562541 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.562707 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.562876 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.562876 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.563161 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.563309 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.563458 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.563638 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.563788 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.563936 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.564090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.564090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.564364 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.564545 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.564695 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.565965 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.566125 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.566268 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.566416 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.566595 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.566758 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.566914 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.567064 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.567214 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.567365 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.567517 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.567680 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.567823 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.567970 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.568119 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.568267 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.568408 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.568558 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.568702 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.568852 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813219-3-iscsi {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.569003 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.569144 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.569298 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.569521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.569684 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.569835 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.569978 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.570118 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.570273 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.570416 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.570556 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.570735 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.570884 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.571027 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.571251 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.571396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.571560 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.571714 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.571857 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.572012 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.572153 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.572295 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.572436 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.572584 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.572736 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.572891 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.573034 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.573182 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.573323 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.573484 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.573667 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.573831 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.573982 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.574137 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.574280 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.574428 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.574636 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.574786 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.575241 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.575887 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.576213 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.576372 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.576540 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.576683 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.576825 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.576965 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.577119 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.577267 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.577426 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.577567 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.577709 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.577856 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.578008 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.578174 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.578317 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.578457 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.578627 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.578775 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.578923 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.579078 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.579220 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.579368 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.579509 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.579649 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.579789 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.579938 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.580096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.580249 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.580398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.580540 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.580693 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.580842 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.580984 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.581132 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.581274 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.581423 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.581573 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.581720 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.581865 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.582521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.582669 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.582759 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.582842 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.582922 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.582991 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.583066 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.583134 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.583201 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.583280 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.583350 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.583426 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.583502 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.583576 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.583662 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.583753 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.583831 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.583900 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.583900 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.584051 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.584132 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.584209 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.584277 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.584357 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.584439 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.584516 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.584592 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.584703 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.584808 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.584901 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.585009 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.585083 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.585083 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.585238 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.585315 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.585383 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.585457 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.585531 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.585612 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.585693 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.585762 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.585829 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.585902 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.585902 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.586031 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.586111 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.586181 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.586247 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.586321 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.586389 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.586455 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.586529 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.586629 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.586714 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.586791 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.586867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.586944 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.587013 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.587080 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.587152 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.587227 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.587304 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.587380 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.587449 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.587523 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.587608 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.587676 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.587754 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.587830 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.587898 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.587971 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.588046 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.588942 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.589121 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.589268 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.589416 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.589565 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.589775 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.589923 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.590065 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.590203 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.590342 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.591077 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.591264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.591413 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.591806 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.591971 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.592112 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.592266 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.592425 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.592566 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.592711 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.592860 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.593013 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.593154 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.593304 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.593445 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.594254 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.594408 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.594559 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.594729 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.594881 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.595034 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.595181 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.595321 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.595476 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.595617 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.595764 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.595913 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.596060 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.596200 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.596347 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.596487 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.596634 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.596779 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.596930 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.597077 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.597217 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.597355 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.597494 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.597632 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.597777 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.597925 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.598066 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.598205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.598344 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.598489 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.598670 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.598833 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.598975 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.599115 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.599254 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 11:29:11.599404 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.599559 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.599711 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.599851 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.599999 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.600141 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.600280 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.600427 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.600576 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.600576 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.600841 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.600992 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.601134 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.601282 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.601429 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.601569 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.601716 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.601864 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.602011 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.602160 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.602300 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.602456 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.602666 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.602813 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.602960 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.603108 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.603256 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.603403 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.603551 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.603691 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.603838 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.603978 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.604125 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.604266 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.604415 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.604554 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.604707 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.604848 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.604987 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.605127 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.605265 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.605412 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.605564 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.605711 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.605858 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.605998 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.606246 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.606979 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.607141 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.607291 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.607434 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.607573 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.607713 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.607865 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.608014 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.608160 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.608312 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.608453 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.608592 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.608760 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.608908 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.609048 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.609195 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.609341 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.609511 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.609676 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.609817 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.609957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.610096 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.610242 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.610388 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.610540 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.610741 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.610889 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.611035 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.611182 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.611335 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.611483 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.611624 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.611771 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.611918 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.612065 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.612217 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.612357 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.612497 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.612651 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.612798 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.612945 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.613093 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.613232 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.613372 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.613511 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.613656 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.613805 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.613953 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.614100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.614246 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.614396 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.614542 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.614721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.614872 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.614872 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.615165 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.615312 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.615457 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.615615 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.615763 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.615909 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.616063 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.616209 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.616371 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.616531 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.616678 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.616824 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.616977 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.617131 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.617284 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.617447 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.617644 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.617804 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.617954 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.618107 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.618268 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.618432 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.618610 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.618765 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.618922 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.619076 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.619300 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.619463 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.619627 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.619627 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.619915 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.620071 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.620230 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.620394 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.620550 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.620697 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.620843 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.620988 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.621148 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.621303 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.621450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.621608 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.621797 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.622460 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.622627 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.622780 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.622949 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.623109 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.623264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.623411 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.623562 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.623709 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.623861 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.624016 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.624164 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.624312 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.624465 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.624619 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.624775 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.624939 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.625087 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.625242 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.625389 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.625541 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.625697 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.625697 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.625983 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.626139 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.626843 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.627017 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.627177 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.627333 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.627492 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.627645 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.627800 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.627947 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.628102 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.628260 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.628409 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.628563 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.628717 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.628877 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.629025 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.629025 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.629322 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.629471 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.629635 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.629793 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.629939 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.630086 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.630233 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.630386 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.630534 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.630718 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.630876 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.631023 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.631169 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.631325 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.631471 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.631627 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.631787 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.631941 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.632095 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.632242 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.632396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.632548 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.632695 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.632841 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.632987 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.633139 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.633304 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.633459 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.633606 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.633760 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.633906 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.634051 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.634210 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.634365 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.634518 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.634706 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.634865 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.635021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.635177 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.635339 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.635339 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.635617 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.635765 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.635910 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.636071 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.636225 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.636371 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.636518 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.636663 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.636828 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.636977 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.637129 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.637293 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.638030 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.638195 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.638352 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.638500 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.638671 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.638819 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.638966 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.639123 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.639286 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.639434 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.639586 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.639742 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.639909 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.640064 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.640224 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.640379 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.640532 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.640687 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.640833 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.640989 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.641143 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.641291 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.641438 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.641591 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.641754 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.641915 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.642063 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.642217 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.642363 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.642518 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.642699 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.642878 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.643471 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.644216 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.644373 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.644533 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.644680 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.644827 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.644973 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.645128 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.645283 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.645438 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.645593 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.645747 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.645903 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.646060 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.646261 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.646425 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.646616 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.646818 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.646972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.647128 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.647278 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.647434 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.647589 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.647737 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.647891 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.648046 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.648192 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.648348 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.648501 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.648676 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.648904 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.649061 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.649061 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.649354 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.649502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.649659 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.649818 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.649974 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.650128 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.650282 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.650431 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.650597 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.650774 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.650929 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.651084 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.651237 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.651392 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.651548 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.651701 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.651855 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.652002 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.652148 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.652294 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.652449 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.652598 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.652761 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.652910 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.653137 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.653293 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.653450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.653599 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.653745 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.653966 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.654116 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.654263 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.654424 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.654635 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.654838 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.654991 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.655149 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.655305 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.655459 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.655605 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.655759 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.655906 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.656058 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.656213 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.656361 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.656514 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.656660 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.656824 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.656972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.657130 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.657278 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.657423 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.657569 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.657715 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.657862 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.658017 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.658172 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.658318 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.658464 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.658638 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.658811 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.658959 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.659112 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.659259 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.659405 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.659501 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.659586 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.659678 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.659678 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.659833 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.659922 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660003 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660093 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660176 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660255 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660335 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660415 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660503 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660598 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660680 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660765 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660848 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.660928 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661017 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661182 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661263 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661352 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661441 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661536 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661627 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661711 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661799 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661880 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.661960 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662053 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662135 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662216 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662216 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662352 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662431 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662519 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662661 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662747 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662829 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662955 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662955 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.662955 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.663366 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.663493 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.663657 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.663866 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.663981 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.664186 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.664293 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.664498 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.664600 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.664892 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.664992 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.665207 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.665299 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.665523 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.665620 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.665840 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.665935 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.666151 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.666249 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.666460 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.666551 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.666797 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.666889 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.667109 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.667206 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.667419 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.667529 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.667746 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.667843 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.668074 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.668163 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.668389 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.668480 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.668733 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.668837 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.669040 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.669298 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.669473 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.669644 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.669808 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.669961 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.670125 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.670275 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.670455 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.670607 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.670903 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.671006 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.671227 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.671330 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.671537 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.671627 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.671854 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.671944 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.672172 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.672285 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.672476 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.672573 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.672784 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.672919 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.673087 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.673224 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.673390 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.673624 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.673764 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.673890 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.674095 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.674231 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.674366 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.674500 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.674657 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.674785 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.674914 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.675024 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.675207 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.675324 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.675515 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.675645 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.675820 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.675958 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.676130 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.676258 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.676436 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.676577 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.676756 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.676884 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.677067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.677196 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.677375 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.677513 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.677682 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.677818 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.677992 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.678120 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.678300 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.678441 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.678638 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.678776 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.678946 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.679074 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.679253 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.679394 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.679558 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.679696 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.679900 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.680028 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.680204 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.680295 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.680508 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.680605 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.680815 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.680905 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.681129 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.681227 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.681921 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.682043 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.682137 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.682243 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.682338 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.682423 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.682505 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.682775 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.682775 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.683032 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.683151 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.683339 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.683502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.683648 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.683868 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.684009 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.684141 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.684826 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.684980 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.685143 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.685143 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.685465 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.685737 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.685862 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.685980 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.686100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.686352 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.686546 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.686873 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.687017 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.687227 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.687484 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.687615 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.687821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.688722 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.688879 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.689009 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.689009 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.689260 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.689437 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.689560 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.689670 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.689772 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.689979 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.690089 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.690406 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.690499 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.690784 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.691089 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.691208 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.691412 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.691530 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.691747 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.691912 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.692067 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.692310 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.692417 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.692652 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.692744 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.692996 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.693312 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.693435 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.693629 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.693787 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.693944 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.694260 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.694372 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.694592 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.694694 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.694965 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.695298 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.695621 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.695877 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.695997 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.696222 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.696329 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.696640 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.696807 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.696973 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.697152 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.697314 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.697483 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.697653 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.697809 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.697991 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.698132 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.698456 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.698554 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.698852 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.699015 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.699191 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.699290 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.699514 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.699614 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.699837 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.700529 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.700817 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.700915 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.701153 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.701262 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.701479 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.701572 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.701803 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.701904 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.702126 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.702221 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.702449 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.702541 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.702793 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.702888 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.703106 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.703338 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.703453 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.703769 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.703870 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.704084 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.704238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.704396 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.704524 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.704716 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.704851 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.705036 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.705202 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.705362 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.705462 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.705677 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.705768 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.705993 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.706085 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.706310 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.706403 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.706653 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.706839 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.706973 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.707161 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.707285 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.707479 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.707601 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.707791 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.707919 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.708115 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.708246 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.708420 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.708587 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.708744 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.708910 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.709067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.709225 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.709380 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.709541 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.709857 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.710027 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.710349 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.710439 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.710691 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.710864 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.711014 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.711115 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.711328 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.711427 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.711640 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.711739 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.711956 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.712061 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.712291 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.712386 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.712603 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.712695 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.712915 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.713016 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.713224 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.713421 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.713555 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.713829 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.713950 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.714135 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.714460 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.714685 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.714797 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.714993 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.715103 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.715407 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.716048 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.716285 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.716462 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.716935 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.717071 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.717365 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.717538 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.717688 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.717781 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.718005 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.718106 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.718339 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.718431 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.718696 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.718792 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.719006 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.719099 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.719330 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.719428 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.719638 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.719729 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.719947 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.720047 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.720264 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.720355 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.720576 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.720675 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.720883 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.720984 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.721190 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.721281 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.721496 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.721586 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.721802 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.721894 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.722107 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.722199 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.722418 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.722522 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.722736 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.722827 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.723064 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.723395 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.723526 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.723698 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.723851 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.723999 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.724148 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.724288 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.724552 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.724723 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.724862 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.725010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.725156 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.725304 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.725449 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.725600 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.725746 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.725893 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.726031 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.726170 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.726320 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.726460 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.726635 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.726726 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.726896 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.726990 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.727214 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.727308 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.727521 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.727611 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.727829 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.727995 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.728135 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.728227 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.728444 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.728535 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.728747 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.728836 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.729065 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.729165 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.729379 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.729471 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.729696 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.729795 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.730007 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.730105 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.730319 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.730417 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.730692 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.730887 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.731010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.731131 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.731892 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.732130 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.732340 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.732505 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.732601 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.732814 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.732905 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.733166 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.733272 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.733510 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.733620 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.733821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.733997 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.734134 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.734341 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.734441 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.734710 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.734816 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.735031 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.735122 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.735377 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.735471 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.735686 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.735786 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.735998 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.736098 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.736311 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.736624 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.736934 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.737032 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.737244 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.737349 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.737553 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.737646 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.737868 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.737960 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.738207 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.738309 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.738522 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.738655 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.738863 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.738960 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.739175 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.739275 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.739489 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.739590 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.739797 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.739895 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.740104 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.740196 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.740410 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.740508 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.740717 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.740818 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.741034 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.741136 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.741365 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.741477 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.741680 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.741786 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.742021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.742170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.742395 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.742500 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.742806 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.742915 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.743138 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.743236 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.743458 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.743678 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.743783 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.743884 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.744079 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.744180 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.744403 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.744504 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.744714 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.744896 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.745032 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.745125 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.745340 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.745433 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.745674 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.745778 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.746012 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.746113 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.746337 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.746429 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.746689 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.746822 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.747072 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.747174 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.747372 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.747513 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.747692 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.747790 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.747997 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.748102 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.748316 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.748414 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.748694 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.748874 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.749040 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.749176 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.749269 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.749557 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.749883 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.749977 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.750196 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.750323 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.750520 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.750663 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.750871 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.750978 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.751206 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.751304 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.751495 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.751611 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.751828 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.751957 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.752138 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.752235 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.752451 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.752560 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.752765 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.752917 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.753067 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.753209 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.753409 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.753577 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.753814 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.753956 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.754102 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.754231 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.754334 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.754428 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.754611 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.754708 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.754924 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.755027 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.755241 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.755336 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.755566 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.755671 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.755881 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.755983 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.756190 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.756284 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.756522 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.756622 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.756833 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.756973 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.757151 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.757252 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.757465 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.757580 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.757778 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.757879 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.758092 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.758221 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.758408 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.758500 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.758759 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.758853 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.759072 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.759163 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.759388 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.759489 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.759706 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.759800 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.760025 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.760124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.760351 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.760451 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.760691 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.760784 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.761014 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.761123 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.761327 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.761432 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.761639 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.761739 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.761944 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.762043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.762187 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 11:29:11.763139 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.763464 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.763850 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.764136 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.764471 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.764795 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.765119 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.765449 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.765761 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.766072 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.766388 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.766741 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.767052 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.767380 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.767694 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.768001 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.768323 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.768639 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.769177 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.769532 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.769853 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.770186 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.770518 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.770868 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.771181 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.771513 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.771825 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.772136 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.772455 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.772769 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.773082 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.773392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.773710 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.774081 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.774391 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.774728 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.775093 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.775426 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.775737 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.776081 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.776392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.776712 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.777019 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.777327 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.777634 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.778083 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.778945 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.779258 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.779569 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.779880 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.780196 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.780512 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.781666 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.781989 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.782514 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.782866 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.783185 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.783522 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.783847 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.784188 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.784533 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.784827 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.785327 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.785612 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.785711 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_db.sqlalchemy.engines [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116082) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:29:11.786186 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.786670 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.787002 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.787355 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.787705 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.788021 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.788334 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.788646 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.788974 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.789289 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.789603 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.789920 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.790235 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.790549 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.790890 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.791202 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.791545 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.791856 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.792177 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.792997 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.793355 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.794257 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.794754 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.795101 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.795402 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.795709 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.796022 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.796337 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.796663 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.797001 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.797324 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.797634 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.798066 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.798383 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.798747 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.799073 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.799388 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.799718 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.800048 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.800362 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.800687 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.800998 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.801333 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.801680 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.802016 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.802349 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.802683 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.802991 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.803299 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.803609 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.803946 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.804286 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.804608 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.804936 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.805249 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.805581 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.805889 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.806217 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.806551 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.806899 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.807203 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.807536 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.807849 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.808162 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.808478 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.808792 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.809102 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.810150 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.810509 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.810870 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.811187 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.811521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.811844 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.812170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.812500 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.812802 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.813139 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.813457 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.813779 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.814123 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.814439 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.814803 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.815122 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.815723 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.816066 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.816406 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.816743 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.817097 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.817415 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.817769 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.818103 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.818425 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.818766 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.819078 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 11:29:11.819323 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 11:29:11.842773 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_db.sqlalchemy.engines [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:29:11.852194 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.context [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2ae07d7-a922-431d-b06a-73b88198aa10(cell1) {{(pid=116082) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 11:29:11.856029 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:11.858465 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:11.859304 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:11.861269 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:11.874654 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_db.sqlalchemy.engines [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116082) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:29:11.875798 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_db.sqlalchemy.engines [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116082) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:29:11.911227 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.context [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2ae07d7-a922-431d-b06a-73b88198aa10(cell1) {{(pid=116083) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 11:29:11.915513 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:11.917104 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:11.917922 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:11.920427 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:11.933190 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_db.sqlalchemy.engines [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:29:11.935027 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_db.sqlalchemy.engines [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:29:12.043264 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_db.sqlalchemy.engines [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116082) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:29:12.100667 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_db.sqlalchemy.engines [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 11:29:12.375375 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: WARNING keystonemiddleware.auth_token [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 11:29:12.379939 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: WARNING keystonemiddleware.auth_token [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 11:29:12.429170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: WARNING keystonemiddleware.auth_token [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 11:29:12.436726 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: WARNING keystonemiddleware.auth_token [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 11:29:12.726488 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: WARNING keystonemiddleware.auth_token [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 11:29:12.732876 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: WARNING keystonemiddleware.auth_token [None req-bfcf12a2-5316-41eb-9217-4f5ac66cb8f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 11:29:12.739087 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55723818e9c0 pid: 116082 (default app) Dec 15 11:29:12.783600 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: WARNING keystonemiddleware.auth_token [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 11:29:12.788862 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: WARNING keystonemiddleware.auth_token [None req-c50368eb-01e9-4684-9e12-3e8ce8e05fc8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 11:29:12.794896 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55723818e9c0 pid: 116083 (default app) Dec 15 11:29:46.042216 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f861f93a-b12e-4305-96da-0ebb32fcdffa tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Action: 'create', calling method: .version_select at 0x7fdf5b881e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-124163386"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:29:48.499694 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f861f93a-b12e-4305-96da-0ebb32fcdffa tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.444674 Dec 15 11:29:48.501087 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1154 bytes} [Wed Dec 15 11:29:45 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3448 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 11:29:49.092445 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e11f787c-a2b4-4281-89a3-5f89ffdd640b tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5b8ceaf0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:49.748878 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e11f787c-a2b4-4281-89a3-5f89ffdd640b tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6" status: 200 len: 345 microversion: 2.1 time: 1.238348 Dec 15 11:29:49.754620 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:29:48 2021] GET /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6 => generated 345 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:29:49.763082 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-eb214d1d-1888-443a-8b69-fb9980f7ec4e tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Action: 'create', calling method: .version_select at 0x7fdf5b8a89d0>, body: {"snapshot": {"volume_id": "a405ae37-8a21-43a9-8a72-7cfc5fc942a6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2085930243"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:29:50.278914 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-eb214d1d-1888-443a-8b69-fb9980f7ec4e tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.520947 Dec 15 11:29:50.279719 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1161 bytes} [Wed Dec 15 11:29:49 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:29:50.292285 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0970937c-6c16-4be3-a73b-81c53a395324 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5b755a60>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:50.365729 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2026733721", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "networks": [{"uuid": "a0f23179-6072-40d7-938d-7958e34367b3"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:29:50.454796 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0970937c-6c16-4be3-a73b-81c53a395324 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20" status: 200 len: 287 microversion: 2.1 time: 0.168450 Dec 15 11:29:50.455360 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 11:29:50 2021] GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20 => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:29:50.469650 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-1d3a88b6-ee3c-4b46-8996-89214700a35a tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5b76c430>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:50.561866 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] validate_networks() for [('a0f23179-6072-40d7-938d-7958e34367b3', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:29:50.568481 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-1d3a88b6-ee3c-4b46-8996-89214700a35a tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.103042 Dec 15 11:29:50.569122 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 4/5] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Dec 15 11:29:50 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:29:50.580176 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-38e5a3bd-ab4c-4c60-91f6-517d259fde8b tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5b6ef310>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:50.659262 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-38e5a3bd-ab4c-4c60-91f6-517d259fde8b tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20" status: 200 len: 287 microversion: 2.1 time: 0.083252 Dec 15 11:29:50.662071 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 5/6] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 11:29:50 2021] GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:29:51.676640 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-512f2b57-c891-4b55-9265-db9e0ecbf99d tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5b76cf70>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:51.745568 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-512f2b57-c891-4b55-9265-db9e0ecbf99d tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20" status: 200 len: 287 microversion: 2.1 time: 0.075807 Dec 15 11:29:51.746667 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 6/7] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 11:29:51 2021] GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:29:52.126813 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:29:52.127996 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:29:52.128875 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:29:52.129351 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:29:52.130330 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:29:52.169921 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:52.170934 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:52.174719 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:52.175401 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:52.311594 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Getting quotas for project de29c0e3e6994463a6c1ab2757e07810. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:29:52.337480 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Getting quotas for user beedd26d2ca345b1a0d2de50592f7989 and project de29c0e3e6994463a6c1ab2757e07810. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:29:52.370890 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:29:52.379546 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:29:52.568929 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-88c02cc4-717d-4a13-946e-74e4b4323091 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.603613 Dec 15 11:29:52.581060 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8da86bbc-55d7-4840-8472-0f220fd88fb6 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:52.583208 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8da86bbc-55d7-4840-8472-0f220fd88fb6 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:29:52.589088 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 2/8] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:29:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 2624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 11:29:52.758195 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e506b393-70f7-4dd3-9572-ee66c4af487d tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5b664790>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:52.861394 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e506b393-70f7-4dd3-9572-ee66c4af487d tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20" status: 200 len: 287 microversion: 2.1 time: 0.106630 Dec 15 11:29:52.862502 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 3/9] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 11:29:52 2021] GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20 => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:29:52.934209 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8da86bbc-55d7-4840-8472-0f220fd88fb6 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:29:52.953652 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8da86bbc-55d7-4840-8472-0f220fd88fb6 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1215 microversion: 2.1 time: 0.377083 Dec 15 11:29:52.954854 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 7/10] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:29:52 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1215 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:29:53.873833 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-01398572-dba9-4dc2-b5dc-fd577d1172d8 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5b664f70>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:53.922291 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-01398572-dba9-4dc2-b5dc-fd577d1172d8 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20" status: 200 len: 288 microversion: 2.1 time: 0.052388 Dec 15 11:29:53.923381 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 4/11] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 11:29:53 2021] GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20 => generated 288 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:29:53.933821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-1d25a7da-4b84-44e7-96a6-a45300d7db2d tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5b76c1f0>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:53.974231 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f72d27af-5af2-492b-842b-b98459674d71 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:53.975448 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f72d27af-5af2-492b-842b-b98459674d71 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:29:54.084937 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-1d25a7da-4b84-44e7-96a6-a45300d7db2d tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20" status: 202 len: 0 microversion: 2.1 time: 0.155405 Dec 15 11:29:54.085792 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 8/12] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Dec 15 11:29:53 2021] DELETE /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:29:54.096400 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-62f784bb-a5df-49e4-8341-9252c08fdc3f tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5b6af790>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:54.145850 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-62f784bb-a5df-49e4-8341-9252c08fdc3f tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20" status: 200 len: 287 microversion: 2.1 time: 0.053265 Dec 15 11:29:54.146879 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 9/13] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 11:29:54 2021] GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:29:54.269889 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f72d27af-5af2-492b-842b-b98459674d71 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:29:54.300661 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f72d27af-5af2-492b-842b-b98459674d71 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1215 microversion: 2.1 time: 0.330570 Dec 15 11:29:54.304191 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 5/14] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:29:53 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1215 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:29:55.164370 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8005d080-b7ee-478e-b27b-8f136656b381 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5b6bd0d0>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:55.221402 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-8005d080-b7ee-478e-b27b-8f136656b381 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] HTTP exception thrown: Snapshot 8d74fd59-9469-4a9e-876e-a586838fde20 could not be found. Dec 15 11:29:55.222968 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8005d080-b7ee-478e-b27b-8f136656b381 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Returning 404 to user: Snapshot 8d74fd59-9469-4a9e-876e-a586838fde20 could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:29:55.225384 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8005d080-b7ee-478e-b27b-8f136656b381 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20" status: 404 len: 111 microversion: 2.1 time: 0.070391 Dec 15 11:29:55.228501 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 10/15] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 11:29:55 2021] GET /compute/v2.1/os-snapshots/8d74fd59-9469-4a9e-876e-a586838fde20 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:29:55.236842 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7227e154-19aa-41ed-9472-d3aedfa9c678 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5ae02c10>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:55.322442 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-92fde75f-d5b8-474f-bfd0-19e477738dca tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:55.324100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-92fde75f-d5b8-474f-bfd0-19e477738dca tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:29:55.338980 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-92fde75f-d5b8-474f-bfd0-19e477738dca tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:55.341864 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-92fde75f-d5b8-474f-bfd0-19e477738dca tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:55.344091 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-92fde75f-d5b8-474f-bfd0-19e477738dca tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:55.345834 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-92fde75f-d5b8-474f-bfd0-19e477738dca tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:55.455598 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7227e154-19aa-41ed-9472-d3aedfa9c678 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6" status: 202 len: 0 microversion: 2.1 time: 0.223315 Dec 15 11:29:55.456762 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 6/16] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 11:29:55 2021] DELETE /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:29:55.466638 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-17207186-daab-4fb3-ab6b-3f83c62a5131 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5ae02dc0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:55.586113 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-17207186-daab-4fb3-ab6b-3f83c62a5131 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6" status: 200 len: 344 microversion: 2.1 time: 0.125033 Dec 15 11:29:55.587619 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 7/17] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:29:55 2021] GET /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6 => generated 344 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:29:55.798721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-92fde75f-d5b8-474f-bfd0-19e477738dca tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:29:55.822451 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-92fde75f-d5b8-474f-bfd0-19e477738dca tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1267 microversion: 2.1 time: 0.504037 Dec 15 11:29:55.822451 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 11/18] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:29:55 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1267 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:29:56.601535 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2c47e640-2e94-487c-a7f5-ef3b4354b9f4 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5ae19c10>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:56.639181 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-2c47e640-2e94-487c-a7f5-ef3b4354b9f4 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] HTTP exception thrown: Volume a405ae37-8a21-43a9-8a72-7cfc5fc942a6 could not be found. Dec 15 11:29:56.639892 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2c47e640-2e94-487c-a7f5-ef3b4354b9f4 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Returning 404 to user: Volume a405ae37-8a21-43a9-8a72-7cfc5fc942a6 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:29:56.641842 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2c47e640-2e94-487c-a7f5-ef3b4354b9f4 tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6" status: 404 len: 109 microversion: 2.1 time: 0.044436 Dec 15 11:29:56.642550 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 8/19] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:29:56 2021] GET /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:29:56.656490 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-babae3fb-f3ef-4373-834b-243abd3b65cc tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5b662f70>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:56.701333 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-babae3fb-f3ef-4373-834b-243abd3b65cc tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] HTTP exception thrown: Volume a405ae37-8a21-43a9-8a72-7cfc5fc942a6 could not be found. Dec 15 11:29:56.701973 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-babae3fb-f3ef-4373-834b-243abd3b65cc tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Returning 404 to user: Volume a405ae37-8a21-43a9-8a72-7cfc5fc942a6 could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:29:56.703090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-babae3fb-f3ef-4373-834b-243abd3b65cc tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6" status: 404 len: 109 microversion: 2.1 time: 0.049997 Dec 15 11:29:56.704137 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 12/20] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 11:29:56 2021] DELETE /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:29:56.712590 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-69b75209-24cd-4294-90d7-088c6c54d4cb tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Calling method '.version_select at 0x7fdf5ae19940>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:56.756492 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-69b75209-24cd-4294-90d7-088c6c54d4cb tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] HTTP exception thrown: Volume a405ae37-8a21-43a9-8a72-7cfc5fc942a6 could not be found. Dec 15 11:29:56.756694 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-69b75209-24cd-4294-90d7-088c6c54d4cb tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] Returning 404 to user: Volume a405ae37-8a21-43a9-8a72-7cfc5fc942a6 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:29:56.757516 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-69b75209-24cd-4294-90d7-088c6c54d4cb tempest-VolumesSnapshotsTestJSON-1154876908 tempest-VolumesSnapshotsTestJSON-1154876908-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6" status: 404 len: 109 microversion: 2.1 time: 0.049154 Dec 15 11:29:56.758234 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 9/21] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:29:56 2021] GET /compute/v2.1/os-volumes/a405ae37-8a21-43a9-8a72-7cfc5fc942a6 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:29:56.841514 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-06726911-b34e-4218-a617-10cf43fe2bd5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:56.842401 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-06726911-b34e-4218-a617-10cf43fe2bd5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:29:56.851684 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-06726911-b34e-4218-a617-10cf43fe2bd5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:56.857099 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-06726911-b34e-4218-a617-10cf43fe2bd5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:56.860164 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-06726911-b34e-4218-a617-10cf43fe2bd5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:56.861123 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-06726911-b34e-4218-a617-10cf43fe2bd5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:57.113472 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-06726911-b34e-4218-a617-10cf43fe2bd5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:29:57.128396 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-06726911-b34e-4218-a617-10cf43fe2bd5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1267 microversion: 2.1 time: 0.292994 Dec 15 11:29:57.134079 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 13/22] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:29:56 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1267 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:29:57.786454 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-4538656", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "747f85b2-40d1-4dee-9b16-7fc3da1e9af9"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:29:57.896447 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] validate_networks() for [('747f85b2-40d1-4dee-9b16-7fc3da1e9af9', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:29:58.147388 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a296ee30-4f01-4baa-b3cd-28fb8ff7f379 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:58.149752 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a296ee30-4f01-4baa-b3cd-28fb8ff7f379 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:29:58.164745 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a296ee30-4f01-4baa-b3cd-28fb8ff7f379 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:58.166082 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a296ee30-4f01-4baa-b3cd-28fb8ff7f379 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:58.168732 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a296ee30-4f01-4baa-b3cd-28fb8ff7f379 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:58.171098 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a296ee30-4f01-4baa-b3cd-28fb8ff7f379 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:58.394560 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a296ee30-4f01-4baa-b3cd-28fb8ff7f379 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:29:58.415812 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a296ee30-4f01-4baa-b3cd-28fb8ff7f379 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1267 microversion: 2.1 time: 0.274158 Dec 15 11:29:58.421421 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 14/23] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:29:58 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:29:59.432869 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3e1dd494-d80f-4794-bece-b35ee36595df tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:29:59.434151 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3e1dd494-d80f-4794-bece-b35ee36595df tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:29:59.444371 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e1dd494-d80f-4794-bece-b35ee36595df tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:59.445015 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e1dd494-d80f-4794-bece-b35ee36595df tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:59.448996 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e1dd494-d80f-4794-bece-b35ee36595df tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:29:59.449633 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e1dd494-d80f-4794-bece-b35ee36595df tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:29:59.589433 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-3e1dd494-d80f-4794-bece-b35ee36595df tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:29:59.623627 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3e1dd494-d80f-4794-bece-b35ee36595df tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1273 microversion: 2.1 time: 0.194875 Dec 15 11:29:59.624721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 15/24] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:29:59 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:00.645325 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5b1eb77e-2c25-4c08-96d2-d85dd026c33e tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:00.647016 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5b1eb77e-2c25-4c08-96d2-d85dd026c33e tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:00.682549 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b1eb77e-2c25-4c08-96d2-d85dd026c33e tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:00.689442 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b1eb77e-2c25-4c08-96d2-d85dd026c33e tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:00.691058 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b1eb77e-2c25-4c08-96d2-d85dd026c33e tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:00.691795 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b1eb77e-2c25-4c08-96d2-d85dd026c33e tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:00.722500 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:30:00.723067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:30:00.723326 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:30:00.723741 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:30:00.724161 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:30:00.762138 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:00.764032 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:00.765312 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:00.770078 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:00.881589 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Getting quotas for project 5a38ce889f1a45c499576f66624cfacf. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:30:00.899843 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Getting quotas for user c49fd055cb064266bdc9de039de2f3e0 and project 5a38ce889f1a45c499576f66624cfacf. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:30:00.943027 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:30:00.951745 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:30:01.062938 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5596f0e0-7e3a-4822-945e-4502ac62d865 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.543063 Dec 15 11:30:01.076412 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 10/25] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:29:57 2021] POST /compute/v2.1/servers => generated 383 bytes in 3559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:30:01.090489 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e3ca5c1b-0df7-4da8-ace5-28d6201028f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:01.097222 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e3ca5c1b-0df7-4da8-ace5-28d6201028f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:01.200729 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-5b1eb77e-2c25-4c08-96d2-d85dd026c33e tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:01.223544 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5b1eb77e-2c25-4c08-96d2-d85dd026c33e tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1273 microversion: 2.1 time: 0.575242 Dec 15 11:30:01.244551 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 16/26] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:00 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1273 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:01.313361 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e3ca5c1b-0df7-4da8-ace5-28d6201028f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:01.328360 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e3ca5c1b-0df7-4da8-ace5-28d6201028f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1219 microversion: 2.1 time: 0.250406 Dec 15 11:30:01.355339 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 11/27] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:01 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1219 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:01.823231 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1370735466", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "747f85b2-40d1-4dee-9b16-7fc3da1e9af9"}]}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:02.241808 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-811b0b74-9a1a-47e0-a542-bb0ff252bdf3 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:02.244385 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-811b0b74-9a1a-47e0-a542-bb0ff252bdf3 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:02.266302 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-811b0b74-9a1a-47e0-a542-bb0ff252bdf3 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:02.267135 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.network.neutron [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] validate_networks() for [('747f85b2-40d1-4dee-9b16-7fc3da1e9af9', None, None, None, None, None)] {{(pid=116082) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:30:02.268072 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-811b0b74-9a1a-47e0-a542-bb0ff252bdf3 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:02.278786 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-811b0b74-9a1a-47e0-a542-bb0ff252bdf3 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:02.285930 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-811b0b74-9a1a-47e0-a542-bb0ff252bdf3 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:03.059022 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-811b0b74-9a1a-47e0-a542-bb0ff252bdf3 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:03.107037 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-811b0b74-9a1a-47e0-a542-bb0ff252bdf3 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1273 microversion: 2.1 time: 0.869137 Dec 15 11:30:03.130823 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 12/28] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:02 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1273 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:04.136315 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8cb7fef6-2d8e-49bc-8424-9c3cfdbb9d19 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:04.137247 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8cb7fef6-2d8e-49bc-8424-9c3cfdbb9d19 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:04.177327 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cb7fef6-2d8e-49bc-8424-9c3cfdbb9d19 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:04.177327 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cb7fef6-2d8e-49bc-8424-9c3cfdbb9d19 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:04.185789 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cb7fef6-2d8e-49bc-8424-9c3cfdbb9d19 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:04.186455 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cb7fef6-2d8e-49bc-8424-9c3cfdbb9d19 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:04.829023 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8cb7fef6-2d8e-49bc-8424-9c3cfdbb9d19 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:04.862392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8cb7fef6-2d8e-49bc-8424-9c3cfdbb9d19 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1273 microversion: 2.1 time: 0.730721 Dec 15 11:30:04.878722 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 13/29] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:04 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1273 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:05.759005 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8d26c0eb-95d3-481d-96e8-4eede72ae83f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'create', calling method: .version_select at 0x7fdf5a5391f0>, body: {"keypair": {"name": "tempest-keypair-1152253885"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:05.835765 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-8d26c0eb-95d3-481d-96e8-4eede72ae83f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:30:05.852234 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-8d26c0eb-95d3-481d-96e8-4eede72ae83f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for user f55f136acecb40ed90a41911e05aa10b and project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:30:07.159302 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Flavor limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:30:07.159864 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Image limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:30:07.160527 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Flavor pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:30:07.160960 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Image pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:30:07.161488 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:30:07.233320 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:07.236191 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:07.240251 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:07.255085 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:07.421987 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-8d26c0eb-95d3-481d-96e8-4eede72ae83f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:30:07.457224 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-8d26c0eb-95d3-481d-96e8-4eede72ae83f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for user f55f136acecb40ed90a41911e05aa10b and project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:30:07.480298 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Getting quotas for project 5a38ce889f1a45c499576f66624cfacf. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:30:07.509850 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Getting quotas for user c49fd055cb064266bdc9de039de2f3e0 and project 5a38ce889f1a45c499576f66624cfacf. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:30:07.526761 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8d26c0eb-95d3-481d-96e8-4eede72ae83f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 2.646813 Dec 15 11:30:07.529171 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 14/30] 10.222.0.18 () {62 vars in 1198 bytes} [Wed Dec 15 11:30:04 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 2650 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 11:30:07.545845 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fcf52642-1db3-4213-b956-29b72f928987 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:07.559739 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fcf52642-1db3-4213-b956-29b72f928987 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:07.576132 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fcf52642-1db3-4213-b956-29b72f928987 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:07.576587 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fcf52642-1db3-4213-b956-29b72f928987 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:07.577407 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fcf52642-1db3-4213-b956-29b72f928987 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:07.577844 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fcf52642-1db3-4213-b956-29b72f928987 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:07.587097 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Going to run 1 instances... {{(pid=116082) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:30:07.602475 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116082) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:30:07.867611 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-69b50ee5-9bcc-4d27-94ed-9924103b7ca2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.049717 Dec 15 11:30:07.868263 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 17/31] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:30:01 2021] POST /compute/v2.1/servers => generated 383 bytes in 6051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:30:07.887651 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4f82e7ed-4b29-4dca-9f3c-dacd7f8f11f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:07.890093 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4f82e7ed-4b29-4dca-9f3c-dacd7f8f11f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:08.478711 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4f82e7ed-4b29-4dca-9f3c-dacd7f8f11f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:08.489483 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4f82e7ed-4b29-4dca-9f3c-dacd7f8f11f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1222 microversion: 2.1 time: 0.612832 Dec 15 11:30:08.499724 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 18/32] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:07 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1222 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:09.674394 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fcf52642-1db3-4213-b956-29b72f928987 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:09.687542 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fcf52642-1db3-4213-b956-29b72f928987 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 2.149247 Dec 15 11:30:09.701184 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 15/33] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:07 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:09.706074 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6133bcb2-c084-4657-ab0f-4603677f46d6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:09.727995 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6133bcb2-c084-4657-ab0f-4603677f46d6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:09.737807 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6133bcb2-c084-4657-ab0f-4603677f46d6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:09.738261 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6133bcb2-c084-4657-ab0f-4603677f46d6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:09.755072 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6133bcb2-c084-4657-ab0f-4603677f46d6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:09.755817 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6133bcb2-c084-4657-ab0f-4603677f46d6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:09.888109 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-82b03f0c-67d2-4a2a-a8c3-9df566329d69 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'create', calling method: .version_select at 0x7fdf5a4ee550>, body: {"keypair": {"name": "tempest-keypair-772178173"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:10.037791 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-82b03f0c-67d2-4a2a-a8c3-9df566329d69 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'key_pairs'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:30:10.043265 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-82b03f0c-67d2-4a2a-a8c3-9df566329d69 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for user 9d42a79896b0419e8ea94d7cb7f23d4e and project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'key_pairs'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:30:10.198403 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-82b03f0c-67d2-4a2a-a8c3-9df566329d69 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'key_pairs'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:30:10.205986 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-82b03f0c-67d2-4a2a-a8c3-9df566329d69 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for user 9d42a79896b0419e8ea94d7cb7f23d4e and project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'key_pairs'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:30:10.285856 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-82b03f0c-67d2-4a2a-a8c3-9df566329d69 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.461241 Dec 15 11:30:10.288121 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 19/34] 10.222.0.18 () {60 vars in 1157 bytes} [Wed Dec 15 11:30:08 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:10.410804 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6133bcb2-c084-4657-ab0f-4603677f46d6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:10.422216 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6133bcb2-c084-4657-ab0f-4603677f46d6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1274 microversion: 2.1 time: 0.719537 Dec 15 11:30:10.446694 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 16/35] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:09 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1274 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:10.711390 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4d3c7cf9-4c5e-47f2-8bc4-8baedee192c2 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:10.712708 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4d3c7cf9-4c5e-47f2-8bc4-8baedee192c2 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:10.744577 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d3c7cf9-4c5e-47f2-8bc4-8baedee192c2 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:10.745421 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d3c7cf9-4c5e-47f2-8bc4-8baedee192c2 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:10.749652 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d3c7cf9-4c5e-47f2-8bc4-8baedee192c2 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:10.756448 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d3c7cf9-4c5e-47f2-8bc4-8baedee192c2 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:11.776861 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-a79953be-8218-4a73-85aa-e1a7f050e032 req-089c88e0-89a5-4b21-b6b8-e56c298a9532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab993417-eae4-48a0-9763-2c0c1556db1f", "tag": "26bc01c0-2c54-4374-81f7-c18e91531b66"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:11.780033 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:11.780033 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:30:11.830633 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-a79953be-8218-4a73-85aa-e1a7f050e032 req-089c88e0-89a5-4b21-b6b8-e56c298a9532 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:11.831972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-a79953be-8218-4a73-85aa-e1a7f050e032 req-089c88e0-89a5-4b21-b6b8-e56c298a9532 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:11.961960 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-a79953be-8218-4a73-85aa-e1a7f050e032 req-089c88e0-89a5-4b21-b6b8-e56c298a9532 service nova] Creating event network-changed:26bc01c0-2c54-4374-81f7-c18e91531b66 for instance ab993417-eae4-48a0-9763-2c0c1556db1f on hv-cinder-81321 Dec 15 11:30:11.963436 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-a79953be-8218-4a73-85aa-e1a7f050e032 req-089c88e0-89a5-4b21-b6b8-e56c298a9532 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116083) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 11:30:11.964778 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76e59b10-a3d4-4a73-b41e-b2fcdc52a9c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:11.965601 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76e59b10-a3d4-4a73-b41e-b2fcdc52a9c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:11.966997 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76e59b10-a3d4-4a73-b41e-b2fcdc52a9c7 None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:11.967735 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76e59b10-a3d4-4a73-b41e-b2fcdc52a9c7 None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:11.978081 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.compute.rpcapi [None req-76e59b10-a3d4-4a73-b41e-b2fcdc52a9c7 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 11:30:11.979354 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76e59b10-a3d4-4a73-b41e-b2fcdc52a9c7 None None] Releasing lock "compute-rpcapi-router" {{(pid=116083) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 11:30:12.046946 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-76e59b10-a3d4-4a73-b41e-b2fcdc52a9c7 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.780889 Dec 15 11:30:12.048223 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 17/36] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:12.054256 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bba69a93-c28f-40e1-bec7-f762cb59b585 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:12.057389 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bba69a93-c28f-40e1-bec7-f762cb59b585 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:12.092473 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bba69a93-c28f-40e1-bec7-f762cb59b585 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:12.094466 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bba69a93-c28f-40e1-bec7-f762cb59b585 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:12.098333 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bba69a93-c28f-40e1-bec7-f762cb59b585 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:12.103670 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bba69a93-c28f-40e1-bec7-f762cb59b585 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:12.478126 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-bba69a93-c28f-40e1-bec7-f762cb59b585 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:12.501810 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bba69a93-c28f-40e1-bec7-f762cb59b585 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1280 microversion: 2.1 time: 0.451311 Dec 15 11:30:12.525927 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 18/37] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:12 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1280 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:13.320482 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4d3c7cf9-4c5e-47f2-8bc4-8baedee192c2 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:13.348522 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4d3c7cf9-4c5e-47f2-8bc4-8baedee192c2 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 2.641136 Dec 15 11:30:13.353828 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 20/38] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:10 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 2650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:13.542144 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8d11d70e-1a16-4ce7-ad2f-8b225d9b8409 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:13.542900 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8d11d70e-1a16-4ce7-ad2f-8b225d9b8409 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:13.554554 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d11d70e-1a16-4ce7-ad2f-8b225d9b8409 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:13.565249 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d11d70e-1a16-4ce7-ad2f-8b225d9b8409 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:13.574264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d11d70e-1a16-4ce7-ad2f-8b225d9b8409 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:13.580617 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d11d70e-1a16-4ce7-ad2f-8b225d9b8409 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:13.949890 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8d11d70e-1a16-4ce7-ad2f-8b225d9b8409 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:13.959431 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8d11d70e-1a16-4ce7-ad2f-8b225d9b8409 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1280 microversion: 2.1 time: 0.421346 Dec 15 11:30:13.971576 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 19/39] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:13 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1280 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:14.373819 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8416a064-8476-43d9-820d-0ce53c55c988 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:14.388295 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8416a064-8476-43d9-820d-0ce53c55c988 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:14.400038 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8416a064-8476-43d9-820d-0ce53c55c988 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:14.400768 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8416a064-8476-43d9-820d-0ce53c55c988 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:14.402367 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8416a064-8476-43d9-820d-0ce53c55c988 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:14.403021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8416a064-8476-43d9-820d-0ce53c55c988 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:14.978029 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fad40b9f-f0c9-4331-99bc-8df538678c6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:14.978845 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fad40b9f-f0c9-4331-99bc-8df538678c6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:14.990458 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fad40b9f-f0c9-4331-99bc-8df538678c6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:14.992486 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fad40b9f-f0c9-4331-99bc-8df538678c6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:14.994146 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fad40b9f-f0c9-4331-99bc-8df538678c6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:14.994919 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fad40b9f-f0c9-4331-99bc-8df538678c6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:15.198131 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fad40b9f-f0c9-4331-99bc-8df538678c6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:15.212215 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fad40b9f-f0c9-4331-99bc-8df538678c6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1280 microversion: 2.1 time: 0.237133 Dec 15 11:30:15.216611 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 20/40] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:14 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1280 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:15.732741 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8416a064-8476-43d9-820d-0ce53c55c988 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:15.749064 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8416a064-8476-43d9-820d-0ce53c55c988 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 1.382341 Dec 15 11:30:15.749880 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 21/41] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:14 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:16.233171 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1abc8d83-b5d6-49bc-bfb6-0c60f662126c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:16.233968 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1abc8d83-b5d6-49bc-bfb6-0c60f662126c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:16.248415 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1abc8d83-b5d6-49bc-bfb6-0c60f662126c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:16.249073 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1abc8d83-b5d6-49bc-bfb6-0c60f662126c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:16.250667 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1abc8d83-b5d6-49bc-bfb6-0c60f662126c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:16.255057 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1abc8d83-b5d6-49bc-bfb6-0c60f662126c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:16.766484 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-56e0ea4d-b638-4c8d-9132-931f5144641c tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:16.767813 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-56e0ea4d-b638-4c8d-9132-931f5144641c tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:16.779618 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-56e0ea4d-b638-4c8d-9132-931f5144641c tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:16.780145 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-56e0ea4d-b638-4c8d-9132-931f5144641c tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:16.781024 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-56e0ea4d-b638-4c8d-9132-931f5144641c tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:16.787074 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-56e0ea4d-b638-4c8d-9132-931f5144641c tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:17.229188 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-56e0ea4d-b638-4c8d-9132-931f5144641c tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:17.236800 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-56e0ea4d-b638-4c8d-9132-931f5144641c tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 0.473916 Dec 15 11:30:17.241105 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 22/42] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:16 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:17.816253 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1abc8d83-b5d6-49bc-bfb6-0c60f662126c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:17.829129 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1abc8d83-b5d6-49bc-bfb6-0c60f662126c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 1.599910 Dec 15 11:30:17.830684 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 21/43] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:16 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:18.256944 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0cc4e3e5-4087-4470-b8c2-65d1b19a7ca0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:18.257823 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-0cc4e3e5-4087-4470-b8c2-65d1b19a7ca0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:18.264838 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0cc4e3e5-4087-4470-b8c2-65d1b19a7ca0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:18.283560 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0cc4e3e5-4087-4470-b8c2-65d1b19a7ca0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:18.286431 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0cc4e3e5-4087-4470-b8c2-65d1b19a7ca0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:18.287096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0cc4e3e5-4087-4470-b8c2-65d1b19a7ca0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:18.849195 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0aaf2230-367d-4d7a-9fd4-c663c5f57d85 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:18.850084 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0aaf2230-367d-4d7a-9fd4-c663c5f57d85 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:18.866315 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aaf2230-367d-4d7a-9fd4-c663c5f57d85 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:18.867438 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aaf2230-367d-4d7a-9fd4-c663c5f57d85 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:18.870527 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aaf2230-367d-4d7a-9fd4-c663c5f57d85 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:18.872097 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aaf2230-367d-4d7a-9fd4-c663c5f57d85 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:18.927098 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-0cc4e3e5-4087-4470-b8c2-65d1b19a7ca0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:18.935209 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0cc4e3e5-4087-4470-b8c2-65d1b19a7ca0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 0.681619 Dec 15 11:30:18.936600 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 23/44] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:18 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:19.449487 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0aaf2230-367d-4d7a-9fd4-c663c5f57d85 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:19.463671 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0aaf2230-367d-4d7a-9fd4-c663c5f57d85 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.615749 Dec 15 11:30:19.464682 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 22/45] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:18 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:19.958561 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9c974185-6b46-40f6-aa88-120842aa30dd tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:19.959883 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9c974185-6b46-40f6-aa88-120842aa30dd tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:19.968690 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c974185-6b46-40f6-aa88-120842aa30dd tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:19.972056 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c974185-6b46-40f6-aa88-120842aa30dd tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:19.973043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c974185-6b46-40f6-aa88-120842aa30dd tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:19.975631 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c974185-6b46-40f6-aa88-120842aa30dd tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:20.046906 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-19f5697b-70d2-4938-9bf7-7ed24f164590 req-e39406be-3e81-46c7-b0a7-d60fffb1b31c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c2f09d7-6122-484a-b99c-33d451ae87a9", "tag": "6dc8d65b-bae1-4e78-9328-c8894e391e1f"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:20.049550 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:20.049550 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:30:20.069524 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-19f5697b-70d2-4938-9bf7-7ed24f164590 req-e39406be-3e81-46c7-b0a7-d60fffb1b31c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:20.070089 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-19f5697b-70d2-4938-9bf7-7ed24f164590 req-e39406be-3e81-46c7-b0a7-d60fffb1b31c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:20.098093 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-19f5697b-70d2-4938-9bf7-7ed24f164590 req-e39406be-3e81-46c7-b0a7-d60fffb1b31c service nova] Creating event network-changed:6dc8d65b-bae1-4e78-9328-c8894e391e1f for instance 9c2f09d7-6122-484a-b99c-33d451ae87a9 on hv-cinder-81321 Dec 15 11:30:20.098679 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-19f5697b-70d2-4938-9bf7-7ed24f164590 req-e39406be-3e81-46c7-b0a7-d60fffb1b31c service nova] Acquired lock "compute-rpcapi-router" {{(pid=116082) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 11:30:20.099977 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7773c193-373a-4f9c-80fc-d27f673880e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:20.100423 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7773c193-373a-4f9c-80fc-d27f673880e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:20.102456 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7773c193-373a-4f9c-80fc-d27f673880e9 None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:20.103133 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7773c193-373a-4f9c-80fc-d27f673880e9 None None] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:20.125459 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.compute.rpcapi [None req-7773c193-373a-4f9c-80fc-d27f673880e9 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 11:30:20.126751 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7773c193-373a-4f9c-80fc-d27f673880e9 None None] Releasing lock "compute-rpcapi-router" {{(pid=116082) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 11:30:20.174900 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7773c193-373a-4f9c-80fc-d27f673880e9 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.471873 Dec 15 11:30:20.175705 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 24/46] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:20.188276 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-61f3832b-5ade-4967-9396-38b4d0b9d4f3 req-9c81a81f-990f-40a0-8876-a073dc449d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bfa4caf-d553-47fb-8527-1eaac916a973", "tag": "5b92eb94-c983-4462-ad97-090ce3b4fc15"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:20.194092 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:20.194092 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:30:20.231575 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-61f3832b-5ade-4967-9396-38b4d0b9d4f3 req-9c81a81f-990f-40a0-8876-a073dc449d35 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:20.232199 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-61f3832b-5ade-4967-9396-38b4d0b9d4f3 req-9c81a81f-990f-40a0-8876-a073dc449d35 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:20.251610 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-61f3832b-5ade-4967-9396-38b4d0b9d4f3 req-9c81a81f-990f-40a0-8876-a073dc449d35 service nova] Creating event network-changed:5b92eb94-c983-4462-ad97-090ce3b4fc15 for instance 3bfa4caf-d553-47fb-8527-1eaac916a973 on hv-cinder-81321 Dec 15 11:30:20.259914 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-61f3832b-5ade-4967-9396-38b4d0b9d4f3 req-9c81a81f-990f-40a0-8876-a073dc449d35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081305 Dec 15 11:30:20.261283 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 25/47] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:20.490050 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-345ade83-d703-45de-9a15-6681e47def5f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:20.492065 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-345ade83-d703-45de-9a15-6681e47def5f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:20.500705 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-345ade83-d703-45de-9a15-6681e47def5f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:20.501311 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-345ade83-d703-45de-9a15-6681e47def5f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:20.502409 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-345ade83-d703-45de-9a15-6681e47def5f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:20.503114 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-345ade83-d703-45de-9a15-6681e47def5f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:20.777670 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9c974185-6b46-40f6-aa88-120842aa30dd tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:20.782888 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9c974185-6b46-40f6-aa88-120842aa30dd tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 0.830885 Dec 15 11:30:20.796313 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 23/48] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:19 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:20.807989 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-345ade83-d703-45de-9a15-6681e47def5f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:20.808544 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-59676130", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "489d15f9-6ae1-4671-9815-ae7c76d0aed9"}], "security_groups": [{"name": "tempest-securitygroup--1000983049"}], "key_name": "tempest-keypair-1152253885", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:20.816086 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-345ade83-d703-45de-9a15-6681e47def5f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.331363 Dec 15 11:30:20.820933 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 26/49] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:20 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:21.018759 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-213471386", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96f54107-e4ae-490e-bbe4-76ba51e710b8"}], "security_groups": [{"name": "tempest-securitygroup--530515402"}], "key_name": "tempest-keypair-772178173", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:21.211490 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] validate_networks() for [('489d15f9-6ae1-4671-9815-ae7c76d0aed9', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:30:21.231265 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.network.neutron [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] validate_networks() for [('96f54107-e4ae-490e-bbe4-76ba51e710b8', None, None, None, None, None)] {{(pid=116082) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:30:22.395153 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Flavor limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:30:22.396339 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Image limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:30:22.397143 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Flavor pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:30:22.398379 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Image pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:30:22.399471 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:30:22.414641 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:22.415063 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:22.415894 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:22.416492 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:22.445855 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:30:22.452184 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for user 9d42a79896b0419e8ea94d7cb7f23d4e and project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:30:22.465567 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Going to run 1 instances... {{(pid=116082) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:30:22.468484 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116082) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:30:22.526532 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4bf145f3-e621-4fa2-98a8-612b92e2d657 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.512084 Dec 15 11:30:22.527413 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 27/50] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:30:21 2021] POST /compute/v2.1/servers => generated 401 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:30:22.532894 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-11376f71-314c-4d52-9b8d-37287188b218 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:22.533754 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-11376f71-314c-4d52-9b8d-37287188b218 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:22.543971 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11376f71-314c-4d52-9b8d-37287188b218 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:22.544654 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11376f71-314c-4d52-9b8d-37287188b218 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:22.545711 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11376f71-314c-4d52-9b8d-37287188b218 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:22.546323 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11376f71-314c-4d52-9b8d-37287188b218 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:22.640793 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:30:22.641287 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:30:22.641679 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:30:22.642185 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:30:22.642607 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:30:22.664202 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:22.664643 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:22.665473 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:22.665908 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:22.717074 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:30:22.726705 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for user f55f136acecb40ed90a41911e05aa10b and project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:30:22.749000 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:30:22.752159 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:30:22.846070 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-11376f71-314c-4d52-9b8d-37287188b218 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:22.859793 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-11376f71-314c-4d52-9b8d-37287188b218 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 0.327484 Dec 15 11:30:22.869601 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 28/51] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:22 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:22.875669 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7868cc88-8e82-480e-9a76-9fd76a9009f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:22.876285 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7868cc88-8e82-480e-9a76-9fd76a9009f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:22.889084 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7f4a2493-88c0-4b8e-8ea4-6b1dea54aefa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.088320 Dec 15 11:30:22.891333 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 24/52] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Dec 15 11:30:20 2021] POST /compute/v2.1/servers => generated 402 bytes in 2094 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 11:30:22.892110 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7868cc88-8e82-480e-9a76-9fd76a9009f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:22.892580 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7868cc88-8e82-480e-9a76-9fd76a9009f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:22.893397 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7868cc88-8e82-480e-9a76-9fd76a9009f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:22.893827 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7868cc88-8e82-480e-9a76-9fd76a9009f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:22.903477 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fd955495-3fd6-4aa0-9d95-e04b32ff99bc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:22.904797 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fd955495-3fd6-4aa0-9d95-e04b32ff99bc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:23.053123 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fd955495-3fd6-4aa0-9d95-e04b32ff99bc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:23.061082 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fd955495-3fd6-4aa0-9d95-e04b32ff99bc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1236 microversion: 2.1 time: 0.166428 Dec 15 11:30:23.068829 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 25/53] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:22 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1236 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:23.073938 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9d5b8dd8-9d47-4678-824b-c6e6100b554c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:23.074557 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9d5b8dd8-9d47-4678-824b-c6e6100b554c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:23.178315 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9d5b8dd8-9d47-4678-824b-c6e6100b554c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:23.204167 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9d5b8dd8-9d47-4678-824b-c6e6100b554c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:23.209772 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9d5b8dd8-9d47-4678-824b-c6e6100b554c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:23.213405 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9d5b8dd8-9d47-4678-824b-c6e6100b554c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1280 microversion: 2.20 time: 0.143526 Dec 15 11:30:23.218193 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 26/54] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:23 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:23.291463 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7868cc88-8e82-480e-9a76-9fd76a9009f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:23.302631 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7868cc88-8e82-480e-9a76-9fd76a9009f8 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.438657 Dec 15 11:30:23.303619 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 29/55] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:22 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:23.854812 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-8fb49dd7-1ae6-4738-a8a8-72203766c47e req-fdff04b7-ee82-4e98-bf1a-c5c4a86c4cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab993417-eae4-48a0-9763-2c0c1556db1f", "name": "network-vif-plugged", "status": "completed", "tag": "26bc01c0-2c54-4374-81f7-c18e91531b66"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:23.856590 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:23.856590 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:30:23.867506 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-8fb49dd7-1ae6-4738-a8a8-72203766c47e req-fdff04b7-ee82-4e98-bf1a-c5c4a86c4cdd service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:23.868565 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-8fb49dd7-1ae6-4738-a8a8-72203766c47e req-fdff04b7-ee82-4e98-bf1a-c5c4a86c4cdd service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:23.886682 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-bd39fde1-bd73-4679-8193-e278f20646ee tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:23.887916 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-bd39fde1-bd73-4679-8193-e278f20646ee tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:23.896844 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bd39fde1-bd73-4679-8193-e278f20646ee tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:23.902129 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bd39fde1-bd73-4679-8193-e278f20646ee tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:23.905137 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bd39fde1-bd73-4679-8193-e278f20646ee tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:23.906070 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bd39fde1-bd73-4679-8193-e278f20646ee tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:23.926422 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-8fb49dd7-1ae6-4738-a8a8-72203766c47e req-fdff04b7-ee82-4e98-bf1a-c5c4a86c4cdd service nova] Creating event network-vif-plugged:26bc01c0-2c54-4374-81f7-c18e91531b66 for instance ab993417-eae4-48a0-9763-2c0c1556db1f on hv-cinder-81321 Dec 15 11:30:23.949619 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-8fb49dd7-1ae6-4738-a8a8-72203766c47e req-fdff04b7-ee82-4e98-bf1a-c5c4a86c4cdd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190879 Dec 15 11:30:23.952279 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 27/56] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:24.089293 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ed24da14-26d8-4dc5-83bb-000bd24375da tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:24.090539 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ed24da14-26d8-4dc5-83bb-000bd24375da tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:24.107137 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed24da14-26d8-4dc5-83bb-000bd24375da tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:24.107863 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed24da14-26d8-4dc5-83bb-000bd24375da tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:24.109988 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed24da14-26d8-4dc5-83bb-000bd24375da tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:24.110643 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed24da14-26d8-4dc5-83bb-000bd24375da tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:24.251356 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ed24da14-26d8-4dc5-83bb-000bd24375da tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:24.259106 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-bd39fde1-bd73-4679-8193-e278f20646ee tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:24.273987 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ed24da14-26d8-4dc5-83bb-000bd24375da tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1288 microversion: 2.1 time: 0.188262 Dec 15 11:30:24.275193 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-bd39fde1-bd73-4679-8193-e278f20646ee tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 0.393746 Dec 15 11:30:24.276340 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 30/57] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:23 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:24.294827 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 28/58] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:24 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1288 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:24.295375 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-db5d064a-a19c-4305-b980-d3e652760124 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:24.296227 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-db5d064a-a19c-4305-b980-d3e652760124 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:24.312404 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-db5d064a-a19c-4305-b980-d3e652760124 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:24.312859 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-db5d064a-a19c-4305-b980-d3e652760124 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:24.313666 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-db5d064a-a19c-4305-b980-d3e652760124 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:24.314154 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-db5d064a-a19c-4305-b980-d3e652760124 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:24.319944 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-05c705a4-6eef-4d27-843d-a2f51de8b28f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:24.320716 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-05c705a4-6eef-4d27-843d-a2f51de8b28f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:24.327957 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05c705a4-6eef-4d27-843d-a2f51de8b28f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:24.328470 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05c705a4-6eef-4d27-843d-a2f51de8b28f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:24.329267 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05c705a4-6eef-4d27-843d-a2f51de8b28f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:24.330594 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05c705a4-6eef-4d27-843d-a2f51de8b28f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:24.556899 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-db5d064a-a19c-4305-b980-d3e652760124 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:24.571397 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-db5d064a-a19c-4305-b980-d3e652760124 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:24.583688 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-db5d064a-a19c-4305-b980-d3e652760124 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:24.585558 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-db5d064a-a19c-4305-b980-d3e652760124 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1332 microversion: 2.20 time: 0.307869 Dec 15 11:30:24.586418 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 31/59] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:24 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1332 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:25.036408 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-05c705a4-6eef-4d27-843d-a2f51de8b28f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:25.045801 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-05c705a4-6eef-4d27-843d-a2f51de8b28f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.729609 Dec 15 11:30:25.050581 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 29/60] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:24 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:25.294425 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-909a3202-4122-486f-b712-56d98bb1158a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:25.296089 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-909a3202-4122-486f-b712-56d98bb1158a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:25.313511 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7e5fae02-d7d2-4e79-86b6-3f7de016d129 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:25.315445 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7e5fae02-d7d2-4e79-86b6-3f7de016d129 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:25.330494 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e5fae02-d7d2-4e79-86b6-3f7de016d129 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:25.332322 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-909a3202-4122-486f-b712-56d98bb1158a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:25.332891 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-909a3202-4122-486f-b712-56d98bb1158a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:25.333214 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e5fae02-d7d2-4e79-86b6-3f7de016d129 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:25.333757 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-909a3202-4122-486f-b712-56d98bb1158a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:25.334199 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-909a3202-4122-486f-b712-56d98bb1158a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:25.335606 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e5fae02-d7d2-4e79-86b6-3f7de016d129 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:25.336225 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e5fae02-d7d2-4e79-86b6-3f7de016d129 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:25.445873 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7e5fae02-d7d2-4e79-86b6-3f7de016d129 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:25.454012 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7e5fae02-d7d2-4e79-86b6-3f7de016d129 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1294 microversion: 2.1 time: 0.149850 Dec 15 11:30:25.456674 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 30/61] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:25 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1294 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:25.576542 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-909a3202-4122-486f-b712-56d98bb1158a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:25.584388 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-909a3202-4122-486f-b712-56d98bb1158a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 0.294357 Dec 15 11:30:25.584983 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 32/62] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:25 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:25.604436 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0155b23f-65e3-4044-927c-6d16be9921a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:25.605410 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0155b23f-65e3-4044-927c-6d16be9921a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:25.614363 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0155b23f-65e3-4044-927c-6d16be9921a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:25.614844 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0155b23f-65e3-4044-927c-6d16be9921a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:25.618498 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0155b23f-65e3-4044-927c-6d16be9921a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:25.619501 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0155b23f-65e3-4044-927c-6d16be9921a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:25.732631 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0155b23f-65e3-4044-927c-6d16be9921a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:25.748118 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0155b23f-65e3-4044-927c-6d16be9921a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:25.749656 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0155b23f-65e3-4044-927c-6d16be9921a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:25.751018 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0155b23f-65e3-4044-927c-6d16be9921a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1338 microversion: 2.20 time: 0.150362 Dec 15 11:30:25.751757 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 31/63] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:25 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1338 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:26.068495 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-12c6de52-0049-4ae7-a1d4-c9db9124b33b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:26.069193 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-12c6de52-0049-4ae7-a1d4-c9db9124b33b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:26.079461 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-12c6de52-0049-4ae7-a1d4-c9db9124b33b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:26.079674 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-12c6de52-0049-4ae7-a1d4-c9db9124b33b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:26.083664 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-12c6de52-0049-4ae7-a1d4-c9db9124b33b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:26.084277 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-12c6de52-0049-4ae7-a1d4-c9db9124b33b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:26.432127 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-12c6de52-0049-4ae7-a1d4-c9db9124b33b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:26.441924 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-12c6de52-0049-4ae7-a1d4-c9db9124b33b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.377263 Dec 15 11:30:26.447340 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 33/64] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:26 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:26.475640 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fddf05b9-eedf-4d60-a776-e13f6fcd41a4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:26.476378 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fddf05b9-eedf-4d60-a776-e13f6fcd41a4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:26.496163 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fddf05b9-eedf-4d60-a776-e13f6fcd41a4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:26.497228 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fddf05b9-eedf-4d60-a776-e13f6fcd41a4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:26.498176 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fddf05b9-eedf-4d60-a776-e13f6fcd41a4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:26.498781 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fddf05b9-eedf-4d60-a776-e13f6fcd41a4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:26.603403 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-28c473f2-7bad-47d2-9809-50669dcb80de tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:26.604518 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-28c473f2-7bad-47d2-9809-50669dcb80de tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:26.612453 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-28c473f2-7bad-47d2-9809-50669dcb80de tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:26.612902 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-28c473f2-7bad-47d2-9809-50669dcb80de tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:26.613692 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-28c473f2-7bad-47d2-9809-50669dcb80de tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:26.617489 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-28c473f2-7bad-47d2-9809-50669dcb80de tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:26.718271 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fddf05b9-eedf-4d60-a776-e13f6fcd41a4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:26.732614 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fddf05b9-eedf-4d60-a776-e13f6fcd41a4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.260487 Dec 15 11:30:26.738617 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 32/65] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:26 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:26.776374 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-637e0a3c-385a-4987-8573-c21b8c71c483 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:26.777083 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-637e0a3c-385a-4987-8573-c21b8c71c483 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:26.791814 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-637e0a3c-385a-4987-8573-c21b8c71c483 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:26.792528 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-637e0a3c-385a-4987-8573-c21b8c71c483 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:26.793862 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-637e0a3c-385a-4987-8573-c21b8c71c483 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:26.794556 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-637e0a3c-385a-4987-8573-c21b8c71c483 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:26.838836 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-28c473f2-7bad-47d2-9809-50669dcb80de tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:26.846329 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-28c473f2-7bad-47d2-9809-50669dcb80de tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 0.246959 Dec 15 11:30:26.847411 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 34/66] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:26 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:27.011161 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-637e0a3c-385a-4987-8573-c21b8c71c483 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:27.019196 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-637e0a3c-385a-4987-8573-c21b8c71c483 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:27.020936 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-637e0a3c-385a-4987-8573-c21b8c71c483 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:27.022238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-637e0a3c-385a-4987-8573-c21b8c71c483 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.256419 Dec 15 11:30:27.032825 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:26 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:27.463711 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-63019fa2-a9cf-4358-9d68-360e54dd31e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:27.464337 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-63019fa2-a9cf-4358-9d68-360e54dd31e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:27.471617 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-63019fa2-a9cf-4358-9d68-360e54dd31e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:27.472074 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-63019fa2-a9cf-4358-9d68-360e54dd31e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:27.473696 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-63019fa2-a9cf-4358-9d68-360e54dd31e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:27.474156 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-63019fa2-a9cf-4358-9d68-360e54dd31e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:27.625929 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-63019fa2-a9cf-4358-9d68-360e54dd31e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:27.638721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-63019fa2-a9cf-4358-9d68-360e54dd31e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.181629 Dec 15 11:30:27.639393 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 35/68] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:27 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:27.750304 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b709d121-4284-48e6-833c-9c43fd217a7f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:27.750944 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b709d121-4284-48e6-833c-9c43fd217a7f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:27.756677 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b709d121-4284-48e6-833c-9c43fd217a7f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:27.758542 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b709d121-4284-48e6-833c-9c43fd217a7f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:27.759392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b709d121-4284-48e6-833c-9c43fd217a7f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:27.759898 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b709d121-4284-48e6-833c-9c43fd217a7f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:27.865306 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0f05e3a0-2dbf-49da-8b39-26c39aab02ba tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:27.865924 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-0f05e3a0-2dbf-49da-8b39-26c39aab02ba tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:27.872306 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0f05e3a0-2dbf-49da-8b39-26c39aab02ba tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:27.872750 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0f05e3a0-2dbf-49da-8b39-26c39aab02ba tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:27.873560 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0f05e3a0-2dbf-49da-8b39-26c39aab02ba tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:27.873995 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0f05e3a0-2dbf-49da-8b39-26c39aab02ba tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:27.933708 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b709d121-4284-48e6-833c-9c43fd217a7f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:27.942979 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b709d121-4284-48e6-833c-9c43fd217a7f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.196385 Dec 15 11:30:27.946586 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 34/69] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:27 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:28.040765 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ed237a08-db7c-4614-b7cd-1fdb33627d56 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:28.041375 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ed237a08-db7c-4614-b7cd-1fdb33627d56 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:28.045897 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-0f05e3a0-2dbf-49da-8b39-26c39aab02ba tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:28.048584 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed237a08-db7c-4614-b7cd-1fdb33627d56 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:28.049226 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed237a08-db7c-4614-b7cd-1fdb33627d56 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:28.050151 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed237a08-db7c-4614-b7cd-1fdb33627d56 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:28.050632 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed237a08-db7c-4614-b7cd-1fdb33627d56 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:28.053666 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0f05e3a0-2dbf-49da-8b39-26c39aab02ba tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 0.193704 Dec 15 11:30:28.064606 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 36/70] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:27 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:28.457150 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-379acb4e-3b83-425c-bce0-c0a7695add21 req-56f5f361-79f6-4685-8372-b064eb2ac440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2f09d7-6122-484a-b99c-33d451ae87a9", "name": "network-vif-plugged", "status": "completed", "tag": "6dc8d65b-bae1-4e78-9328-c8894e391e1f"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:28.459186 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:28.459186 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:30:28.462886 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ed237a08-db7c-4614-b7cd-1fdb33627d56 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:28.479416 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ed237a08-db7c-4614-b7cd-1fdb33627d56 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:28.483534 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ed237a08-db7c-4614-b7cd-1fdb33627d56 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:28.487728 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ed237a08-db7c-4614-b7cd-1fdb33627d56 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.451528 Dec 15 11:30:28.489356 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 35/71] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:28 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:28.491118 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-379acb4e-3b83-425c-bce0-c0a7695add21 req-56f5f361-79f6-4685-8372-b064eb2ac440 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:28.492890 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-379acb4e-3b83-425c-bce0-c0a7695add21 req-56f5f361-79f6-4685-8372-b064eb2ac440 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:28.520737 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-379acb4e-3b83-425c-bce0-c0a7695add21 req-56f5f361-79f6-4685-8372-b064eb2ac440 service nova] Creating event network-vif-plugged:6dc8d65b-bae1-4e78-9328-c8894e391e1f for instance 9c2f09d7-6122-484a-b99c-33d451ae87a9 on hv-cinder-81321 Dec 15 11:30:28.526812 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-379acb4e-3b83-425c-bce0-c0a7695add21 req-56f5f361-79f6-4685-8372-b064eb2ac440 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074086 Dec 15 11:30:28.528111 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 37/72] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:28.697464 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0b3662aa-eb9f-4b37-9869-3ef0ee31155c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:28.698470 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0b3662aa-eb9f-4b37-9869-3ef0ee31155c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:28.716593 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b3662aa-eb9f-4b37-9869-3ef0ee31155c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:28.718775 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b3662aa-eb9f-4b37-9869-3ef0ee31155c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:28.719520 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b3662aa-eb9f-4b37-9869-3ef0ee31155c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:28.719966 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b3662aa-eb9f-4b37-9869-3ef0ee31155c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:28.977784 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-18de6dbb-1555-49d8-9b86-ab744956cb21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:28.980616 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-18de6dbb-1555-49d8-9b86-ab744956cb21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:29.010971 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18de6dbb-1555-49d8-9b86-ab744956cb21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:29.012814 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18de6dbb-1555-49d8-9b86-ab744956cb21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:29.018209 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18de6dbb-1555-49d8-9b86-ab744956cb21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:29.020553 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18de6dbb-1555-49d8-9b86-ab744956cb21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:29.223901 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0b3662aa-eb9f-4b37-9869-3ef0ee31155c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:29.241961 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0b3662aa-eb9f-4b37-9869-3ef0ee31155c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.548919 Dec 15 11:30:29.242588 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 36/73] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:28 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:29.260911 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e706110c-4e23-4356-b279-d21fa8e65ac4 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:29.261532 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e706110c-4e23-4356-b279-d21fa8e65ac4 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:29.285920 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e706110c-4e23-4356-b279-d21fa8e65ac4 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:29.286650 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e706110c-4e23-4356-b279-d21fa8e65ac4 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:29.291861 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e706110c-4e23-4356-b279-d21fa8e65ac4 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:29.294264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e706110c-4e23-4356-b279-d21fa8e65ac4 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:29.475433 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-18de6dbb-1555-49d8-9b86-ab744956cb21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:29.487878 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-18de6dbb-1555-49d8-9b86-ab744956cb21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.528351 Dec 15 11:30:29.490686 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 38/74] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:28 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:29.509661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-22f7eab8-1b71-47c4-98c4-d1f9175fd2c7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:29.511196 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-22f7eab8-1b71-47c4-98c4-d1f9175fd2c7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:29.549843 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22f7eab8-1b71-47c4-98c4-d1f9175fd2c7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:29.552377 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22f7eab8-1b71-47c4-98c4-d1f9175fd2c7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:29.557475 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22f7eab8-1b71-47c4-98c4-d1f9175fd2c7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:29.558470 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22f7eab8-1b71-47c4-98c4-d1f9175fd2c7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:29.990361 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e706110c-4e23-4356-b279-d21fa8e65ac4 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:30.018148 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e706110c-4e23-4356-b279-d21fa8e65ac4 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1315 microversion: 2.1 time: 0.766244 Dec 15 11:30:30.034932 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 37/75] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:29 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:30.053842 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-1b72d8f2-521a-434b-9b79-3116b4a862e0 req-651dba19-6003-48d3-9b78-3c968730d8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0866db17-45ec-4550-b834-8880e974be1d", "tag": "b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:30.055994 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:30.055994 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:30:30.077513 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1b72d8f2-521a-434b-9b79-3116b4a862e0 req-651dba19-6003-48d3-9b78-3c968730d8e1 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:30.077970 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1b72d8f2-521a-434b-9b79-3116b4a862e0 req-651dba19-6003-48d3-9b78-3c968730d8e1 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:30.098261 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-1b72d8f2-521a-434b-9b79-3116b4a862e0 req-651dba19-6003-48d3-9b78-3c968730d8e1 service nova] Creating event network-changed:b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d for instance 0866db17-45ec-4550-b834-8880e974be1d on hv-cinder-81321 Dec 15 11:30:30.105099 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-1b72d8f2-521a-434b-9b79-3116b4a862e0 req-651dba19-6003-48d3-9b78-3c968730d8e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068785 Dec 15 11:30:30.106285 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 38/76] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:30.114395 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-de8536a5-1fcc-4326-bade-0618a7aba239 req-02d8a049-92f4-4a8b-9415-adb14b1d18d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ab2164-7f19-4c54-8e4e-91295c45a538", "tag": "038396f8-c2e8-482c-a9e9-cf23fb211312"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:30.133147 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:30.133147 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:30:30.138407 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-22f7eab8-1b71-47c4-98c4-d1f9175fd2c7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:30.146733 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-de8536a5-1fcc-4326-bade-0618a7aba239 req-02d8a049-92f4-4a8b-9415-adb14b1d18d5 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:30.151128 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-22f7eab8-1b71-47c4-98c4-d1f9175fd2c7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:30.151620 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-de8536a5-1fcc-4326-bade-0618a7aba239 req-02d8a049-92f4-4a8b-9415-adb14b1d18d5 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:30.154341 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-22f7eab8-1b71-47c4-98c4-d1f9175fd2c7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:30.160027 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-22f7eab8-1b71-47c4-98c4-d1f9175fd2c7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.655179 Dec 15 11:30:30.166845 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-de8536a5-1fcc-4326-bade-0618a7aba239 req-02d8a049-92f4-4a8b-9415-adb14b1d18d5 service nova] Creating event network-changed:038396f8-c2e8-482c-a9e9-cf23fb211312 for instance 23ab2164-7f19-4c54-8e4e-91295c45a538 on hv-cinder-81321 Dec 15 11:30:30.171404 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 39/77] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:29 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:30.176804 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-de8536a5-1fcc-4326-bade-0618a7aba239 req-02d8a049-92f4-4a8b-9415-adb14b1d18d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066572 Dec 15 11:30:30.177684 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 39/78] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:30.262341 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-90ba7908-8c47-4437-a6be-2f732f5df3cd tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:30.263263 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-90ba7908-8c47-4437-a6be-2f732f5df3cd tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:30.271411 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-90ba7908-8c47-4437-a6be-2f732f5df3cd tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:30.273348 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-90ba7908-8c47-4437-a6be-2f732f5df3cd tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:30.274504 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-90ba7908-8c47-4437-a6be-2f732f5df3cd tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:30.275148 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-90ba7908-8c47-4437-a6be-2f732f5df3cd tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:30.508870 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8d5bd7d6-0a1d-4534-91f0-e49065b6fc13 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:30.510143 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8d5bd7d6-0a1d-4534-91f0-e49065b6fc13 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:30.520067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d5bd7d6-0a1d-4534-91f0-e49065b6fc13 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:30.523725 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d5bd7d6-0a1d-4534-91f0-e49065b6fc13 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:30.524763 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d5bd7d6-0a1d-4534-91f0-e49065b6fc13 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:30.525384 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d5bd7d6-0a1d-4534-91f0-e49065b6fc13 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:30.552891 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-90ba7908-8c47-4437-a6be-2f732f5df3cd tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:30.576826 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-90ba7908-8c47-4437-a6be-2f732f5df3cd tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.321104 Dec 15 11:30:30.578865 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 40/79] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:30 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:30.609732 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-c040e670-bd14-44b7-8670-521f1bb6d35b req-83b62bdd-6eaa-4197-aa1f-e4dca4ec1de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfa4caf-d553-47fb-8527-1eaac916a973", "name": "network-vif-plugged", "status": "completed", "tag": "5b92eb94-c983-4462-ad97-090ce3b4fc15"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:30.616656 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:30.616656 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:30:30.641541 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-c040e670-bd14-44b7-8670-521f1bb6d35b req-83b62bdd-6eaa-4197-aa1f-e4dca4ec1de8 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:30.642234 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-c040e670-bd14-44b7-8670-521f1bb6d35b req-83b62bdd-6eaa-4197-aa1f-e4dca4ec1de8 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:30.672330 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-c040e670-bd14-44b7-8670-521f1bb6d35b req-83b62bdd-6eaa-4197-aa1f-e4dca4ec1de8 service nova] Creating event network-vif-plugged:5b92eb94-c983-4462-ad97-090ce3b4fc15 for instance 3bfa4caf-d553-47fb-8527-1eaac916a973 on hv-cinder-81321 Dec 15 11:30:30.680841 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-c040e670-bd14-44b7-8670-521f1bb6d35b req-83b62bdd-6eaa-4197-aa1f-e4dca4ec1de8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089078 Dec 15 11:30:30.681979 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 41/80] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:30.806832 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8d5bd7d6-0a1d-4534-91f0-e49065b6fc13 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:30.818475 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8d5bd7d6-0a1d-4534-91f0-e49065b6fc13 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.312274 Dec 15 11:30:30.821237 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 40/81] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:30 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:31.036438 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-08881b90-7753-4474-aa95-a8d67ff64aeb tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:31.037126 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-08881b90-7753-4474-aa95-a8d67ff64aeb tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:31.048036 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-08881b90-7753-4474-aa95-a8d67ff64aeb tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:31.050605 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-08881b90-7753-4474-aa95-a8d67ff64aeb tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:31.051594 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-08881b90-7753-4474-aa95-a8d67ff64aeb tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:31.052050 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-08881b90-7753-4474-aa95-a8d67ff64aeb tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:31.179529 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7972dbd1-e0f9-446b-aeee-f6ef9fd86d10 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:31.180694 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7972dbd1-e0f9-446b-aeee-f6ef9fd86d10 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:31.191640 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7972dbd1-e0f9-446b-aeee-f6ef9fd86d10 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:31.195971 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7972dbd1-e0f9-446b-aeee-f6ef9fd86d10 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:31.198073 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7972dbd1-e0f9-446b-aeee-f6ef9fd86d10 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:31.199755 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7972dbd1-e0f9-446b-aeee-f6ef9fd86d10 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:31.246719 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-08881b90-7753-4474-aa95-a8d67ff64aeb tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:31.260162 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-08881b90-7753-4474-aa95-a8d67ff64aeb tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1502 microversion: 2.1 time: 0.227522 Dec 15 11:30:31.261673 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 42/82] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:31 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:31.417796 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7972dbd1-e0f9-446b-aeee-f6ef9fd86d10 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:31.433976 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7972dbd1-e0f9-446b-aeee-f6ef9fd86d10 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:31.435944 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7972dbd1-e0f9-446b-aeee-f6ef9fd86d10 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:31.437441 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7972dbd1-e0f9-446b-aeee-f6ef9fd86d10 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.263094 Dec 15 11:30:31.440255 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 41/83] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:31 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:31.598028 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4732595c-a7a6-4394-9f0a-ecf146c42f67 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:31.608070 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4732595c-a7a6-4394-9f0a-ecf146c42f67 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:31.622239 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4732595c-a7a6-4394-9f0a-ecf146c42f67 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:31.622904 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4732595c-a7a6-4394-9f0a-ecf146c42f67 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:31.623918 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4732595c-a7a6-4394-9f0a-ecf146c42f67 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:31.624711 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4732595c-a7a6-4394-9f0a-ecf146c42f67 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:31.803144 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4732595c-a7a6-4394-9f0a-ecf146c42f67 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:31.814246 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4732595c-a7a6-4394-9f0a-ecf146c42f67 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.219751 Dec 15 11:30:31.815889 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 43/84] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:31 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:31.838368 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cd7d69ff-3969-4114-8f4f-41569901be10 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:31.841010 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cd7d69ff-3969-4114-8f4f-41569901be10 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:31.850051 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd7d69ff-3969-4114-8f4f-41569901be10 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:31.850559 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd7d69ff-3969-4114-8f4f-41569901be10 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:31.851713 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd7d69ff-3969-4114-8f4f-41569901be10 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:31.852160 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd7d69ff-3969-4114-8f4f-41569901be10 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:32.059385 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cd7d69ff-3969-4114-8f4f-41569901be10 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:32.070560 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cd7d69ff-3969-4114-8f4f-41569901be10 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.235782 Dec 15 11:30:32.071607 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 42/85] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:31 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:32.456173 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fc1796e0-3368-44d1-8c63-52400787a6ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:32.457073 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fc1796e0-3368-44d1-8c63-52400787a6ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:32.463711 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc1796e0-3368-44d1-8c63-52400787a6ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:32.464157 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc1796e0-3368-44d1-8c63-52400787a6ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:32.464934 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc1796e0-3368-44d1-8c63-52400787a6ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:32.465359 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc1796e0-3368-44d1-8c63-52400787a6ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:32.667780 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fc1796e0-3368-44d1-8c63-52400787a6ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:32.677360 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fc1796e0-3368-44d1-8c63-52400787a6ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:32.678908 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fc1796e0-3368-44d1-8c63-52400787a6ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:32.680277 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fc1796e0-3368-44d1-8c63-52400787a6ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.228327 Dec 15 11:30:32.680830 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 44/86] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:32 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:32.832772 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-745b61a8-9813-4719-a0c5-5ac1778cdeed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:32.833623 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-745b61a8-9813-4719-a0c5-5ac1778cdeed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:32.841161 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-745b61a8-9813-4719-a0c5-5ac1778cdeed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:32.841729 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-745b61a8-9813-4719-a0c5-5ac1778cdeed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:32.842713 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-745b61a8-9813-4719-a0c5-5ac1778cdeed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:32.843210 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-745b61a8-9813-4719-a0c5-5ac1778cdeed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:33.024107 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-745b61a8-9813-4719-a0c5-5ac1778cdeed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:33.034595 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-745b61a8-9813-4719-a0c5-5ac1778cdeed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.205647 Dec 15 11:30:33.046867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 43/87] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:32 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:33.089736 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8724f36d-1162-481a-91ad-cad42fb0d5ed tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:33.090532 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8724f36d-1162-481a-91ad-cad42fb0d5ed tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:33.096982 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8724f36d-1162-481a-91ad-cad42fb0d5ed tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:33.097133 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8724f36d-1162-481a-91ad-cad42fb0d5ed tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:33.097928 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8724f36d-1162-481a-91ad-cad42fb0d5ed tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:33.098357 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8724f36d-1162-481a-91ad-cad42fb0d5ed tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:33.253871 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8724f36d-1162-481a-91ad-cad42fb0d5ed tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:33.263906 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8724f36d-1162-481a-91ad-cad42fb0d5ed tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.179281 Dec 15 11:30:33.264473 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 45/88] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:33 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:33.699660 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2d587c36-5aea-405b-a614-2cf24db2647f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:33.702258 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2d587c36-5aea-405b-a614-2cf24db2647f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:33.715202 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d587c36-5aea-405b-a614-2cf24db2647f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:33.715733 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d587c36-5aea-405b-a614-2cf24db2647f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:33.716662 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d587c36-5aea-405b-a614-2cf24db2647f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:33.717267 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d587c36-5aea-405b-a614-2cf24db2647f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:34.031472 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2d587c36-5aea-405b-a614-2cf24db2647f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:34.045469 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2d587c36-5aea-405b-a614-2cf24db2647f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:34.047780 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2d587c36-5aea-405b-a614-2cf24db2647f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:34.056093 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-660cfc07-7729-4e60-81ac-07ebf1b6ecab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:34.057598 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-660cfc07-7729-4e60-81ac-07ebf1b6ecab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:34.063788 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2d587c36-5aea-405b-a614-2cf24db2647f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.368732 Dec 15 11:30:34.066459 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 44/89] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:33 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:34.068206 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-660cfc07-7729-4e60-81ac-07ebf1b6ecab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:34.068921 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-660cfc07-7729-4e60-81ac-07ebf1b6ecab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:34.071010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-660cfc07-7729-4e60-81ac-07ebf1b6ecab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:34.072325 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-660cfc07-7729-4e60-81ac-07ebf1b6ecab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:34.281310 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1dad661b-3c4a-4a27-b790-60d62775aa05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:34.282461 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1dad661b-3c4a-4a27-b790-60d62775aa05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:34.288691 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1dad661b-3c4a-4a27-b790-60d62775aa05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:34.289209 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1dad661b-3c4a-4a27-b790-60d62775aa05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:34.296592 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1dad661b-3c4a-4a27-b790-60d62775aa05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:34.297108 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1dad661b-3c4a-4a27-b790-60d62775aa05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:34.577443 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-660cfc07-7729-4e60-81ac-07ebf1b6ecab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:34.588047 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-660cfc07-7729-4e60-81ac-07ebf1b6ecab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.538224 Dec 15 11:30:34.594742 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 46/90] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:34 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:34.914747 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1dad661b-3c4a-4a27-b790-60d62775aa05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:34.923453 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1dad661b-3c4a-4a27-b790-60d62775aa05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.645706 Dec 15 11:30:34.927588 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 45/91] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:34 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:34.957502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8e8c43d3-fea5-432c-915c-c368a14a1061 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b56ea2f6-29c5-4002-b66d-e66e13fc38e7"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:34.965227 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8e8c43d3-fea5-432c-915c-c368a14a1061 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:34.984594 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8e8c43d3-fea5-432c-915c-c368a14a1061 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:34.986901 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8e8c43d3-fea5-432c-915c-c368a14a1061 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:34.987951 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8e8c43d3-fea5-432c-915c-c368a14a1061 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:34.988770 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8e8c43d3-fea5-432c-915c-c368a14a1061 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:35.085422 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2cc5321d-1648-403e-8ea9-df4f19d8692f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:35.087740 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2cc5321d-1648-403e-8ea9-df4f19d8692f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:35.093978 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cc5321d-1648-403e-8ea9-df4f19d8692f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:35.094364 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cc5321d-1648-403e-8ea9-df4f19d8692f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:35.095413 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cc5321d-1648-403e-8ea9-df4f19d8692f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:35.095748 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cc5321d-1648-403e-8ea9-df4f19d8692f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:35.392082 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2cc5321d-1648-403e-8ea9-df4f19d8692f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:35.402064 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2cc5321d-1648-403e-8ea9-df4f19d8692f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:35.426378 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2cc5321d-1648-403e-8ea9-df4f19d8692f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:35.445217 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2cc5321d-1648-403e-8ea9-df4f19d8692f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.364281 Dec 15 11:30:35.447111 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 46/92] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:35 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:35.607847 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-729173f7-24ce-4686-8ee9-933cbf34243e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:35.608791 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-729173f7-24ce-4686-8ee9-933cbf34243e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:35.622983 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-729173f7-24ce-4686-8ee9-933cbf34243e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:35.623514 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-729173f7-24ce-4686-8ee9-933cbf34243e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:35.625213 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-729173f7-24ce-4686-8ee9-933cbf34243e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:35.635367 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-729173f7-24ce-4686-8ee9-933cbf34243e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:35.892444 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8e8c43d3-fea5-432c-915c-c368a14a1061 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "POST /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.939098 Dec 15 11:30:35.894829 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 47/93] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:30:34 2021] POST /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f/os-volume_attachments => generated 194 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:35.948444 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-50a53893-71d4-46a4-b530-658cbd3fc658 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:35.949770 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-50a53893-71d4-46a4-b530-658cbd3fc658 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:35.962653 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-50a53893-71d4-46a4-b530-658cbd3fc658 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:35.963357 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-50a53893-71d4-46a4-b530-658cbd3fc658 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:35.964855 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-50a53893-71d4-46a4-b530-658cbd3fc658 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:35.965529 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-50a53893-71d4-46a4-b530-658cbd3fc658 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:36.189040 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-729173f7-24ce-4686-8ee9-933cbf34243e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:36.197148 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-729173f7-24ce-4686-8ee9-933cbf34243e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1322 microversion: 2.1 time: 0.594782 Dec 15 11:30:36.198011 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 47/94] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:35 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:36.298703 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-50a53893-71d4-46a4-b530-658cbd3fc658 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:36.313901 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-50a53893-71d4-46a4-b530-658cbd3fc658 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.370811 Dec 15 11:30:36.315715 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 48/95] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:35 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:36.465717 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1fe0522c-b814-4a49-ac2a-cb1a14dadb4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:36.466316 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1fe0522c-b814-4a49-ac2a-cb1a14dadb4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:36.475921 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fe0522c-b814-4a49-ac2a-cb1a14dadb4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:36.476477 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fe0522c-b814-4a49-ac2a-cb1a14dadb4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:36.477335 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fe0522c-b814-4a49-ac2a-cb1a14dadb4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:36.477879 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fe0522c-b814-4a49-ac2a-cb1a14dadb4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:36.671638 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1fe0522c-b814-4a49-ac2a-cb1a14dadb4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:36.679401 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1fe0522c-b814-4a49-ac2a-cb1a14dadb4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:36.680881 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1fe0522c-b814-4a49-ac2a-cb1a14dadb4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:36.681979 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1fe0522c-b814-4a49-ac2a-cb1a14dadb4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.221276 Dec 15 11:30:36.682534 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 48/96] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:36 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:37.216573 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fe23e954-0645-43d3-9578-15d7cb0f8516 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:37.217603 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fe23e954-0645-43d3-9578-15d7cb0f8516 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:37.232853 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fe23e954-0645-43d3-9578-15d7cb0f8516 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:37.233584 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fe23e954-0645-43d3-9578-15d7cb0f8516 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:37.234078 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fe23e954-0645-43d3-9578-15d7cb0f8516 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:37.234506 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fe23e954-0645-43d3-9578-15d7cb0f8516 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:37.331764 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-77fb05e6-bcb5-4db9-b6f8-943f322c47f6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:37.332983 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-77fb05e6-bcb5-4db9-b6f8-943f322c47f6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:37.344380 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77fb05e6-bcb5-4db9-b6f8-943f322c47f6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:37.345013 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77fb05e6-bcb5-4db9-b6f8-943f322c47f6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:37.347209 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77fb05e6-bcb5-4db9-b6f8-943f322c47f6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:37.349027 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77fb05e6-bcb5-4db9-b6f8-943f322c47f6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:37.527170 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fe23e954-0645-43d3-9578-15d7cb0f8516 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:37.555095 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fe23e954-0645-43d3-9578-15d7cb0f8516 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1515 microversion: 2.1 time: 0.345416 Dec 15 11:30:37.567442 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 49/97] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:37 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1515 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:37.574977 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-47529796-6f7f-4cc3-b727-e1de031e8893 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:37.578267 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-47529796-6f7f-4cc3-b727-e1de031e8893 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:37.590005 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-77fb05e6-bcb5-4db9-b6f8-943f322c47f6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:37.593227 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-47529796-6f7f-4cc3-b727-e1de031e8893 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:37.593969 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-47529796-6f7f-4cc3-b727-e1de031e8893 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:37.595117 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-47529796-6f7f-4cc3-b727-e1de031e8893 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:37.597298 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-77fb05e6-bcb5-4db9-b6f8-943f322c47f6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.269205 Dec 15 11:30:37.598186 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 49/98] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:37 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:37.598822 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-47529796-6f7f-4cc3-b727-e1de031e8893 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:37.625201 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-47529796-6f7f-4cc3-b727-e1de031e8893 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lazy-loading 'flavor' on Instance uuid 3bfa4caf-d553-47fb-8527-1eaac916a973 {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:30:37.699232 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e3f7b477-1da9-4c76-a36e-bc99fcb08d08 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:37.700039 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e3f7b477-1da9-4c76-a36e-bc99fcb08d08 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:37.706397 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e3f7b477-1da9-4c76-a36e-bc99fcb08d08 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:37.707518 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e3f7b477-1da9-4c76-a36e-bc99fcb08d08 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:37.708941 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e3f7b477-1da9-4c76-a36e-bc99fcb08d08 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:37.710493 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e3f7b477-1da9-4c76-a36e-bc99fcb08d08 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:37.801508 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-47529796-6f7f-4cc3-b727-e1de031e8893 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "POST /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973/action" status: 200 len: 32 microversion: 2.1 time: 0.229622 Dec 15 11:30:37.803828 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 50/99] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:30:37 2021] POST /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:30:37.815508 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-23dd7c2c-6db0-4bc2-b3ac-2e19fffe42e4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:37.821303 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-23dd7c2c-6db0-4bc2-b3ac-2e19fffe42e4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:37.829963 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-23dd7c2c-6db0-4bc2-b3ac-2e19fffe42e4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:37.831918 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-23dd7c2c-6db0-4bc2-b3ac-2e19fffe42e4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:37.833035 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-23dd7c2c-6db0-4bc2-b3ac-2e19fffe42e4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:37.836537 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-23dd7c2c-6db0-4bc2-b3ac-2e19fffe42e4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:37.927177 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e3f7b477-1da9-4c76-a36e-bc99fcb08d08 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:37.937064 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e3f7b477-1da9-4c76-a36e-bc99fcb08d08 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:37.938544 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e3f7b477-1da9-4c76-a36e-bc99fcb08d08 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:37.939692 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e3f7b477-1da9-4c76-a36e-bc99fcb08d08 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.244284 Dec 15 11:30:37.940249 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 50/100] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:37 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:38.073474 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-23dd7c2c-6db0-4bc2-b3ac-2e19fffe42e4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:38.080968 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-23dd7c2c-6db0-4bc2-b3ac-2e19fffe42e4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.272627 Dec 15 11:30:38.081580 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 51/101] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:37 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:38.614801 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-31c88b51-59fc-4527-872e-b2a509a2f6a2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:38.615350 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-31c88b51-59fc-4527-872e-b2a509a2f6a2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:38.622102 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-31c88b51-59fc-4527-872e-b2a509a2f6a2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:38.622102 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-31c88b51-59fc-4527-872e-b2a509a2f6a2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:38.622396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-31c88b51-59fc-4527-872e-b2a509a2f6a2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:38.628603 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-31c88b51-59fc-4527-872e-b2a509a2f6a2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:38.797331 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-31c88b51-59fc-4527-872e-b2a509a2f6a2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:38.808222 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-31c88b51-59fc-4527-872e-b2a509a2f6a2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.196969 Dec 15 11:30:38.809116 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 51/102] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:38 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:38.957875 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-375039df-c9fc-416d-9376-d0a1248c6ee9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:38.959052 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-375039df-c9fc-416d-9376-d0a1248c6ee9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:38.965375 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-375039df-c9fc-416d-9376-d0a1248c6ee9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:38.966013 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-375039df-c9fc-416d-9376-d0a1248c6ee9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:38.967002 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-375039df-c9fc-416d-9376-d0a1248c6ee9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:38.967436 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-375039df-c9fc-416d-9376-d0a1248c6ee9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:39.099477 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-78dba3b3-e98f-484d-89df-d145897bb319 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:39.100727 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-78dba3b3-e98f-484d-89df-d145897bb319 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:39.112656 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78dba3b3-e98f-484d-89df-d145897bb319 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:39.112891 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-375039df-c9fc-416d-9376-d0a1248c6ee9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:39.113749 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78dba3b3-e98f-484d-89df-d145897bb319 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:39.115223 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78dba3b3-e98f-484d-89df-d145897bb319 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:39.116355 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78dba3b3-e98f-484d-89df-d145897bb319 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:39.121969 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-375039df-c9fc-416d-9376-d0a1248c6ee9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:39.123496 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-375039df-c9fc-416d-9376-d0a1248c6ee9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:39.124732 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-375039df-c9fc-416d-9376-d0a1248c6ee9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.170422 Dec 15 11:30:39.125466 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 52/103] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:38 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:39.255376 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-78dba3b3-e98f-484d-89df-d145897bb319 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:39.263627 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-78dba3b3-e98f-484d-89df-d145897bb319 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.169290 Dec 15 11:30:39.264198 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 52/104] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:39 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:39.825128 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-042233e1-ec5e-44f4-a28c-2084ff91eec9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:39.825749 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-042233e1-ec5e-44f4-a28c-2084ff91eec9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:39.832678 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-042233e1-ec5e-44f4-a28c-2084ff91eec9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:39.836847 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-042233e1-ec5e-44f4-a28c-2084ff91eec9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:39.838552 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-042233e1-ec5e-44f4-a28c-2084ff91eec9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:39.840150 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-042233e1-ec5e-44f4-a28c-2084ff91eec9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:40.143832 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9c12abbe-4e60-4d3b-99a3-26533e9c9fe4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:40.145641 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9c12abbe-4e60-4d3b-99a3-26533e9c9fe4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:40.156288 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c12abbe-4e60-4d3b-99a3-26533e9c9fe4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:40.158354 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c12abbe-4e60-4d3b-99a3-26533e9c9fe4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:40.160995 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c12abbe-4e60-4d3b-99a3-26533e9c9fe4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:40.162613 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c12abbe-4e60-4d3b-99a3-26533e9c9fe4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:40.278364 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-042233e1-ec5e-44f4-a28c-2084ff91eec9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:40.295628 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-042233e1-ec5e-44f4-a28c-2084ff91eec9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.473316 Dec 15 11:30:40.296740 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 53/105] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:39 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:40.305774 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6433715d-452d-472b-a89d-336d68d646d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:40.310230 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6433715d-452d-472b-a89d-336d68d646d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:40.320747 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6433715d-452d-472b-a89d-336d68d646d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:40.322416 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6433715d-452d-472b-a89d-336d68d646d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:40.330110 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6433715d-452d-472b-a89d-336d68d646d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:40.330994 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6433715d-452d-472b-a89d-336d68d646d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:40.432281 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9c12abbe-4e60-4d3b-99a3-26533e9c9fe4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:40.453486 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9c12abbe-4e60-4d3b-99a3-26533e9c9fe4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:40.457277 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9c12abbe-4e60-4d3b-99a3-26533e9c9fe4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:40.460267 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9c12abbe-4e60-4d3b-99a3-26533e9c9fe4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.319343 Dec 15 11:30:40.466909 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 53/106] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:40 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:40.582814 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6433715d-452d-472b-a89d-336d68d646d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:40.591732 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6433715d-452d-472b-a89d-336d68d646d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.292010 Dec 15 11:30:40.592579 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 54/107] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:40 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:41.312264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e6928770-ea78-46d8-9a81-00add1bed400 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:41.312789 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e6928770-ea78-46d8-9a81-00add1bed400 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:41.319301 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6928770-ea78-46d8-9a81-00add1bed400 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:41.319773 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6928770-ea78-46d8-9a81-00add1bed400 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:41.320551 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6928770-ea78-46d8-9a81-00add1bed400 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:41.321013 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6928770-ea78-46d8-9a81-00add1bed400 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:41.455203 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e6928770-ea78-46d8-9a81-00add1bed400 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:41.463599 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e6928770-ea78-46d8-9a81-00add1bed400 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.155110 Dec 15 11:30:41.464157 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 54/108] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:41 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:41.480378 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ef22edc8-20e1-418f-b5a7-95cec6ff0222 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:41.481095 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-ef22edc8-20e1-418f-b5a7-95cec6ff0222 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:41.487544 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ef22edc8-20e1-418f-b5a7-95cec6ff0222 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:41.487993 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ef22edc8-20e1-418f-b5a7-95cec6ff0222 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:41.488776 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ef22edc8-20e1-418f-b5a7-95cec6ff0222 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:41.489286 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ef22edc8-20e1-418f-b5a7-95cec6ff0222 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:41.597114 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-d0280496-f156-47d5-a385-0ad5c7676ed3 req-e48dcd47-9741-4bf8-8f88-2416e6c39ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0866db17-45ec-4550-b834-8880e974be1d", "name": "network-vif-plugged", "status": "completed", "tag": "b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:41.598745 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:41.598745 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:30:41.613425 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-d0280496-f156-47d5-a385-0ad5c7676ed3 req-e48dcd47-9741-4bf8-8f88-2416e6c39ff3 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:41.613873 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-d0280496-f156-47d5-a385-0ad5c7676ed3 req-e48dcd47-9741-4bf8-8f88-2416e6c39ff3 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:41.632738 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-d0280496-f156-47d5-a385-0ad5c7676ed3 req-e48dcd47-9741-4bf8-8f88-2416e6c39ff3 service nova] Creating event network-vif-plugged:b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d for instance 0866db17-45ec-4550-b834-8880e974be1d on hv-cinder-81321 Dec 15 11:30:41.637747 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-d0280496-f156-47d5-a385-0ad5c7676ed3 req-e48dcd47-9741-4bf8-8f88-2416e6c39ff3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044120 Dec 15 11:30:41.638347 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 55/109] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:30:41.645346 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c51824bc-9525-4375-83ed-d90b3b46b086 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:41.646225 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c51824bc-9525-4375-83ed-d90b3b46b086 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:41.652809 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c51824bc-9525-4375-83ed-d90b3b46b086 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:41.653567 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c51824bc-9525-4375-83ed-d90b3b46b086 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:41.654457 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c51824bc-9525-4375-83ed-d90b3b46b086 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:41.655110 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c51824bc-9525-4375-83ed-d90b3b46b086 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:41.677120 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ef22edc8-20e1-418f-b5a7-95cec6ff0222 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:41.685733 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ef22edc8-20e1-418f-b5a7-95cec6ff0222 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:41.693153 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ef22edc8-20e1-418f-b5a7-95cec6ff0222 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:41.696061 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ef22edc8-20e1-418f-b5a7-95cec6ff0222 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.219299 Dec 15 11:30:41.696634 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 55/110] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:41 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:41.839813 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c51824bc-9525-4375-83ed-d90b3b46b086 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:41.848244 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c51824bc-9525-4375-83ed-d90b3b46b086 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.208503 Dec 15 11:30:41.858412 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 56/111] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:41 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:42.480763 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6f1dfd75-81a5-47ee-b262-042e00c4d809 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:42.481375 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6f1dfd75-81a5-47ee-b262-042e00c4d809 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:42.487215 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f1dfd75-81a5-47ee-b262-042e00c4d809 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:42.487664 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f1dfd75-81a5-47ee-b262-042e00c4d809 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:42.488437 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f1dfd75-81a5-47ee-b262-042e00c4d809 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:42.488875 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f1dfd75-81a5-47ee-b262-042e00c4d809 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:42.627835 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6f1dfd75-81a5-47ee-b262-042e00c4d809 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:42.635163 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6f1dfd75-81a5-47ee-b262-042e00c4d809 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.158325 Dec 15 11:30:42.635727 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 56/112] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:42 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:42.713261 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-345d5893-f2ba-4f42-b09f-1bf3d085ad5c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:42.713863 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-345d5893-f2ba-4f42-b09f-1bf3d085ad5c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:42.719780 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-345d5893-f2ba-4f42-b09f-1bf3d085ad5c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:42.720214 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-345d5893-f2ba-4f42-b09f-1bf3d085ad5c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:42.720971 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-345d5893-f2ba-4f42-b09f-1bf3d085ad5c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:42.721394 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-345d5893-f2ba-4f42-b09f-1bf3d085ad5c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:42.852873 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-345d5893-f2ba-4f42-b09f-1bf3d085ad5c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:42.860670 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-345d5893-f2ba-4f42-b09f-1bf3d085ad5c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:42.862204 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-345d5893-f2ba-4f42-b09f-1bf3d085ad5c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:42.863330 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-345d5893-f2ba-4f42-b09f-1bf3d085ad5c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.154109 Dec 15 11:30:42.863883 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 57/113] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:42 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:42.864212 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-009a9adb-b9b9-4194-bf95-f96a2a8e7c38 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:42.864895 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-009a9adb-b9b9-4194-bf95-f96a2a8e7c38 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:42.871883 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-009a9adb-b9b9-4194-bf95-f96a2a8e7c38 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:42.872444 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-009a9adb-b9b9-4194-bf95-f96a2a8e7c38 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:42.873335 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-009a9adb-b9b9-4194-bf95-f96a2a8e7c38 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:42.874004 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-009a9adb-b9b9-4194-bf95-f96a2a8e7c38 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:43.003255 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-009a9adb-b9b9-4194-bf95-f96a2a8e7c38 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:43.011435 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-009a9adb-b9b9-4194-bf95-f96a2a8e7c38 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.150727 Dec 15 11:30:43.012079 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 57/114] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:42 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:43.651762 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8781fdd2-5c5f-423f-8aef-08ac4ea934c8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:43.652622 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8781fdd2-5c5f-423f-8aef-08ac4ea934c8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:43.656743 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-ee47e9c3-e04f-480a-8320-cec5406b6b30 req-a6ab6919-1802-4ccd-91e9-07978dd66b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ab2164-7f19-4c54-8e4e-91295c45a538", "name": "network-vif-plugged", "status": "completed", "tag": "038396f8-c2e8-482c-a9e9-cf23fb211312"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:43.658336 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:43.658336 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:30:43.658955 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8781fdd2-5c5f-423f-8aef-08ac4ea934c8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:43.659398 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8781fdd2-5c5f-423f-8aef-08ac4ea934c8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:43.660167 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8781fdd2-5c5f-423f-8aef-08ac4ea934c8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:43.660593 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8781fdd2-5c5f-423f-8aef-08ac4ea934c8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:43.665322 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-ee47e9c3-e04f-480a-8320-cec5406b6b30 req-a6ab6919-1802-4ccd-91e9-07978dd66b8f service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:43.665766 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-ee47e9c3-e04f-480a-8320-cec5406b6b30 req-a6ab6919-1802-4ccd-91e9-07978dd66b8f service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:43.676363 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-ee47e9c3-e04f-480a-8320-cec5406b6b30 req-a6ab6919-1802-4ccd-91e9-07978dd66b8f service nova] Creating event network-vif-plugged:038396f8-c2e8-482c-a9e9-cf23fb211312 for instance 23ab2164-7f19-4c54-8e4e-91295c45a538 on hv-cinder-81321 Dec 15 11:30:43.681535 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-ee47e9c3-e04f-480a-8320-cec5406b6b30 req-a6ab6919-1802-4ccd-91e9-07978dd66b8f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028379 Dec 15 11:30:43.682114 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 58/115] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:43.788749 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8781fdd2-5c5f-423f-8aef-08ac4ea934c8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:43.795847 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8781fdd2-5c5f-423f-8aef-08ac4ea934c8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.148062 Dec 15 11:30:43.796415 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 58/116] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:43 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:43.881606 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a542eaff-dbf7-4d6a-a225-0c2773c7d4e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:43.882205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a542eaff-dbf7-4d6a-a225-0c2773c7d4e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:43.888307 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a542eaff-dbf7-4d6a-a225-0c2773c7d4e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:43.888748 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a542eaff-dbf7-4d6a-a225-0c2773c7d4e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:43.889522 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a542eaff-dbf7-4d6a-a225-0c2773c7d4e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:43.889951 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a542eaff-dbf7-4d6a-a225-0c2773c7d4e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:44.020267 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a542eaff-dbf7-4d6a-a225-0c2773c7d4e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:44.028090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a542eaff-dbf7-4d6a-a225-0c2773c7d4e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:44.028279 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f4745fcf-3f74-48a0-bc11-346ae7871510 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:44.028808 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f4745fcf-3f74-48a0-bc11-346ae7871510 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:44.029853 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a542eaff-dbf7-4d6a-a225-0c2773c7d4e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:44.030970 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a542eaff-dbf7-4d6a-a225-0c2773c7d4e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.153512 Dec 15 11:30:44.031550 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 59/117] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:43 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:44.034771 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f4745fcf-3f74-48a0-bc11-346ae7871510 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:44.035219 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f4745fcf-3f74-48a0-bc11-346ae7871510 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:44.035990 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f4745fcf-3f74-48a0-bc11-346ae7871510 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:44.036425 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f4745fcf-3f74-48a0-bc11-346ae7871510 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:44.168501 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f4745fcf-3f74-48a0-bc11-346ae7871510 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:44.176152 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f4745fcf-3f74-48a0-bc11-346ae7871510 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.151452 Dec 15 11:30:44.176713 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 59/118] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:44 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:44.813961 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-13a9d454-eb4b-4efc-8564-924429f9193d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:44.814589 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-13a9d454-eb4b-4efc-8564-924429f9193d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:44.821502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-13a9d454-eb4b-4efc-8564-924429f9193d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:44.821947 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-13a9d454-eb4b-4efc-8564-924429f9193d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:44.822776 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-13a9d454-eb4b-4efc-8564-924429f9193d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:44.823218 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-13a9d454-eb4b-4efc-8564-924429f9193d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:44.953783 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-13a9d454-eb4b-4efc-8564-924429f9193d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:44.961471 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-13a9d454-eb4b-4efc-8564-924429f9193d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.151188 Dec 15 11:30:44.962303 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 60/119] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:44 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:45.048837 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0f6f17b3-f894-4c6d-80d0-2a59630d05cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:45.049440 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0f6f17b3-f894-4c6d-80d0-2a59630d05cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:45.056004 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f6f17b3-f894-4c6d-80d0-2a59630d05cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:45.056446 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f6f17b3-f894-4c6d-80d0-2a59630d05cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:45.057207 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f6f17b3-f894-4c6d-80d0-2a59630d05cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:45.057632 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f6f17b3-f894-4c6d-80d0-2a59630d05cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:45.184445 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0f6f17b3-f894-4c6d-80d0-2a59630d05cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:45.192428 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0f6f17b3-f894-4c6d-80d0-2a59630d05cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:45.194723 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0f6f17b3-f894-4c6d-80d0-2a59630d05cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:45.195999 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0f6f17b3-f894-4c6d-80d0-2a59630d05cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.150819 Dec 15 11:30:45.196737 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d835f4a0-f1f9-4fcd-acad-16343022c36d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:45.196867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 60/120] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:45 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:45.197507 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d835f4a0-f1f9-4fcd-acad-16343022c36d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:45.203783 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d835f4a0-f1f9-4fcd-acad-16343022c36d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:45.204324 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d835f4a0-f1f9-4fcd-acad-16343022c36d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:45.205298 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d835f4a0-f1f9-4fcd-acad-16343022c36d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:45.205725 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d835f4a0-f1f9-4fcd-acad-16343022c36d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:45.342897 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d835f4a0-f1f9-4fcd-acad-16343022c36d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:45.350866 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d835f4a0-f1f9-4fcd-acad-16343022c36d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.160908 Dec 15 11:30:45.351585 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 61/121] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:45 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:45.978809 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e9edc5ad-7fc6-41e4-9478-1d29a9c2387e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:45.979413 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e9edc5ad-7fc6-41e4-9478-1d29a9c2387e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:45.985531 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e9edc5ad-7fc6-41e4-9478-1d29a9c2387e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:45.985912 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e9edc5ad-7fc6-41e4-9478-1d29a9c2387e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:45.986696 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e9edc5ad-7fc6-41e4-9478-1d29a9c2387e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:45.987124 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e9edc5ad-7fc6-41e4-9478-1d29a9c2387e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:46.117318 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e9edc5ad-7fc6-41e4-9478-1d29a9c2387e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:46.124474 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e9edc5ad-7fc6-41e4-9478-1d29a9c2387e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.149918 Dec 15 11:30:46.125029 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 61/122] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:45 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:46.214063 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-85e07f9f-361f-4422-9d0d-02e98744f172 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:46.214700 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-85e07f9f-361f-4422-9d0d-02e98744f172 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:46.220870 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85e07f9f-361f-4422-9d0d-02e98744f172 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:46.221318 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85e07f9f-361f-4422-9d0d-02e98744f172 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:46.222098 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85e07f9f-361f-4422-9d0d-02e98744f172 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:46.222532 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85e07f9f-361f-4422-9d0d-02e98744f172 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:46.348925 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-85e07f9f-361f-4422-9d0d-02e98744f172 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:46.357218 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-85e07f9f-361f-4422-9d0d-02e98744f172 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:46.358739 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-85e07f9f-361f-4422-9d0d-02e98744f172 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:46.359837 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-85e07f9f-361f-4422-9d0d-02e98744f172 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.150323 Dec 15 11:30:46.360390 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 62/123] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:46 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:46.368385 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-758a9505-88c6-4bff-97f5-92e1ade6c688 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:46.368997 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-758a9505-88c6-4bff-97f5-92e1ade6c688 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:46.375094 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-758a9505-88c6-4bff-97f5-92e1ade6c688 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:46.375542 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-758a9505-88c6-4bff-97f5-92e1ade6c688 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:46.376348 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-758a9505-88c6-4bff-97f5-92e1ade6c688 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:46.376795 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-758a9505-88c6-4bff-97f5-92e1ade6c688 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:46.502781 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-758a9505-88c6-4bff-97f5-92e1ade6c688 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:46.510444 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-758a9505-88c6-4bff-97f5-92e1ade6c688 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.146619 Dec 15 11:30:46.511060 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 62/124] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:46 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:47.140891 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a405a40c-692c-4de7-84bd-a5b3e4d80493 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:47.141496 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a405a40c-692c-4de7-84bd-a5b3e4d80493 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:47.148048 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a405a40c-692c-4de7-84bd-a5b3e4d80493 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:47.148497 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a405a40c-692c-4de7-84bd-a5b3e4d80493 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:47.149267 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a405a40c-692c-4de7-84bd-a5b3e4d80493 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:47.149699 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a405a40c-692c-4de7-84bd-a5b3e4d80493 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:47.284432 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a405a40c-692c-4de7-84bd-a5b3e4d80493 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:47.291690 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a405a40c-692c-4de7-84bd-a5b3e4d80493 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.154395 Dec 15 11:30:47.292246 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 63/125] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:47 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:47.377774 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-327a0fd8-befa-47e2-9d38-c79ecb789284 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:47.378376 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-327a0fd8-befa-47e2-9d38-c79ecb789284 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:47.385021 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-327a0fd8-befa-47e2-9d38-c79ecb789284 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:47.385465 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-327a0fd8-befa-47e2-9d38-c79ecb789284 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:47.386230 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-327a0fd8-befa-47e2-9d38-c79ecb789284 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:47.386694 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-327a0fd8-befa-47e2-9d38-c79ecb789284 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:47.519387 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-327a0fd8-befa-47e2-9d38-c79ecb789284 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:47.527438 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5b1b740c-2e06-4e02-8144-a83a199a8eee tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:47.527611 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-327a0fd8-befa-47e2-9d38-c79ecb789284 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:47.528046 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5b1b740c-2e06-4e02-8144-a83a199a8eee tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:47.528980 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-327a0fd8-befa-47e2-9d38-c79ecb789284 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:47.530070 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-327a0fd8-befa-47e2-9d38-c79ecb789284 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.155952 Dec 15 11:30:47.530714 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 63/126] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:47 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:30:47.533942 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b1b740c-2e06-4e02-8144-a83a199a8eee tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:47.534390 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b1b740c-2e06-4e02-8144-a83a199a8eee tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:47.535201 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b1b740c-2e06-4e02-8144-a83a199a8eee tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:47.535637 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b1b740c-2e06-4e02-8144-a83a199a8eee tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:47.664916 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-5b1b740c-2e06-4e02-8144-a83a199a8eee tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:47.672154 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5b1b740c-2e06-4e02-8144-a83a199a8eee tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.148262 Dec 15 11:30:47.672657 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 64/127] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:47 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:48.307831 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b6feb142-6cbe-40d0-9a13-23067d9cac49 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:48.308439 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b6feb142-6cbe-40d0-9a13-23067d9cac49 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:48.314335 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b6feb142-6cbe-40d0-9a13-23067d9cac49 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:48.314813 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b6feb142-6cbe-40d0-9a13-23067d9cac49 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:48.315586 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b6feb142-6cbe-40d0-9a13-23067d9cac49 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:48.316011 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b6feb142-6cbe-40d0-9a13-23067d9cac49 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:48.456740 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b6feb142-6cbe-40d0-9a13-23067d9cac49 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:48.464811 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b6feb142-6cbe-40d0-9a13-23067d9cac49 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1361 microversion: 2.1 time: 0.160824 Dec 15 11:30:48.465370 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 64/128] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:48 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:48.547836 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-52f92e69-6a93-40bf-b47f-a72dbc6df05c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:48.548450 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-52f92e69-6a93-40bf-b47f-a72dbc6df05c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:48.554941 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-52f92e69-6a93-40bf-b47f-a72dbc6df05c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:48.555398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-52f92e69-6a93-40bf-b47f-a72dbc6df05c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:48.556367 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-52f92e69-6a93-40bf-b47f-a72dbc6df05c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:48.556793 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-52f92e69-6a93-40bf-b47f-a72dbc6df05c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:48.690230 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-78ad3bd9-d7ee-43a6-bb26-2f1742796d0f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:48.690870 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-78ad3bd9-d7ee-43a6-bb26-2f1742796d0f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:48.692158 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-52f92e69-6a93-40bf-b47f-a72dbc6df05c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:48.697747 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78ad3bd9-d7ee-43a6-bb26-2f1742796d0f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:48.698193 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78ad3bd9-d7ee-43a6-bb26-2f1742796d0f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:48.699192 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78ad3bd9-d7ee-43a6-bb26-2f1742796d0f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:48.699620 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78ad3bd9-d7ee-43a6-bb26-2f1742796d0f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:48.700714 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-52f92e69-6a93-40bf-b47f-a72dbc6df05c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:48.702228 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-52f92e69-6a93-40bf-b47f-a72dbc6df05c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:48.703350 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-52f92e69-6a93-40bf-b47f-a72dbc6df05c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1406 microversion: 2.20 time: 0.159214 Dec 15 11:30:48.703901 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 65/129] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:48 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:30:48.871971 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-78ad3bd9-d7ee-43a6-bb26-2f1742796d0f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:48.882591 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-78ad3bd9-d7ee-43a6-bb26-2f1742796d0f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.194333 Dec 15 11:30:48.882591 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 65/130] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:48 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:49.482627 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-02a9cc28-e1aa-4c1d-9017-13b12bb7ebb1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:49.483242 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-02a9cc28-e1aa-4c1d-9017-13b12bb7ebb1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:49.489589 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-02a9cc28-e1aa-4c1d-9017-13b12bb7ebb1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:49.490058 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-02a9cc28-e1aa-4c1d-9017-13b12bb7ebb1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:49.491474 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-02a9cc28-e1aa-4c1d-9017-13b12bb7ebb1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:49.492069 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-02a9cc28-e1aa-4c1d-9017-13b12bb7ebb1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:49.655246 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-02a9cc28-e1aa-4c1d-9017-13b12bb7ebb1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:49.664183 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-02a9cc28-e1aa-4c1d-9017-13b12bb7ebb1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1547 microversion: 2.1 time: 0.186244 Dec 15 11:30:49.664821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 66/131] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:49 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1547 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:49.681285 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fa3b93db-5987-4c91-8b2b-0c6e5a734f2a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:49.681845 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fa3b93db-5987-4c91-8b2b-0c6e5a734f2a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:49.687904 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa3b93db-5987-4c91-8b2b-0c6e5a734f2a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:49.688354 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa3b93db-5987-4c91-8b2b-0c6e5a734f2a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:49.689129 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa3b93db-5987-4c91-8b2b-0c6e5a734f2a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:49.689555 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa3b93db-5987-4c91-8b2b-0c6e5a734f2a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:49.727733 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6b519b34-fda7-4f4d-8a56-2a6e20388f43 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:49.743354 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6b519b34-fda7-4f4d-8a56-2a6e20388f43 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:49.755109 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6b519b34-fda7-4f4d-8a56-2a6e20388f43 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:49.755810 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6b519b34-fda7-4f4d-8a56-2a6e20388f43 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:49.757398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6b519b34-fda7-4f4d-8a56-2a6e20388f43 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:49.757910 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6b519b34-fda7-4f4d-8a56-2a6e20388f43 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:49.835116 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fa3b93db-5987-4c91-8b2b-0c6e5a734f2a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156877 Dec 15 11:30:49.835714 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 66/132] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Dec 15 11:30:49 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:49.899399 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6fbab4d8-a757-4b9a-b66b-74e168aa5790 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:49.900012 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6fbab4d8-a757-4b9a-b66b-74e168aa5790 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:49.915199 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6fbab4d8-a757-4b9a-b66b-74e168aa5790 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:49.915968 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6fbab4d8-a757-4b9a-b66b-74e168aa5790 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:49.917096 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6fbab4d8-a757-4b9a-b66b-74e168aa5790 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:49.919583 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6fbab4d8-a757-4b9a-b66b-74e168aa5790 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:49.923533 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6b519b34-fda7-4f4d-8a56-2a6e20388f43 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:49.942103 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6b519b34-fda7-4f4d-8a56-2a6e20388f43 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:49.943709 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6b519b34-fda7-4f4d-8a56-2a6e20388f43 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:49.957159 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6b519b34-fda7-4f4d-8a56-2a6e20388f43 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1597 microversion: 2.20 time: 0.238403 Dec 15 11:30:49.959090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 67/133] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:30:49 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1597 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:30:49.984789 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e7775c0d-2300-4868-9792-ea47ec51173a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:49.985234 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e7775c0d-2300-4868-9792-ea47ec51173a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:50.010509 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e7775c0d-2300-4868-9792-ea47ec51173a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:50.011274 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e7775c0d-2300-4868-9792-ea47ec51173a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:50.012211 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e7775c0d-2300-4868-9792-ea47ec51173a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:50.012795 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e7775c0d-2300-4868-9792-ea47ec51173a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:50.129196 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e7775c0d-2300-4868-9792-ea47ec51173a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.148454 Dec 15 11:30:50.130056 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 68/134] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Dec 15 11:30:49 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:30:50.378361 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6fbab4d8-a757-4b9a-b66b-74e168aa5790 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:50.388138 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6fbab4d8-a757-4b9a-b66b-74e168aa5790 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.493935 Dec 15 11:30:50.392382 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 67/135] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:49 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:51.409922 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b0a11982-2a1e-4ab3-b5d1-bf282113bfeb tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:51.410529 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b0a11982-2a1e-4ab3-b5d1-bf282113bfeb tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:51.416949 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b0a11982-2a1e-4ab3-b5d1-bf282113bfeb tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:51.417461 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b0a11982-2a1e-4ab3-b5d1-bf282113bfeb tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:51.418246 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b0a11982-2a1e-4ab3-b5d1-bf282113bfeb tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:51.418695 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b0a11982-2a1e-4ab3-b5d1-bf282113bfeb tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:51.629381 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4557abcd-7178-40ce-9f56-3ee323f0f14b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:51.631539 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4557abcd-7178-40ce-9f56-3ee323f0f14b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:51.645803 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4557abcd-7178-40ce-9f56-3ee323f0f14b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:51.646792 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4557abcd-7178-40ce-9f56-3ee323f0f14b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:51.648689 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4557abcd-7178-40ce-9f56-3ee323f0f14b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:51.651538 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4557abcd-7178-40ce-9f56-3ee323f0f14b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:51.656755 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b0a11982-2a1e-4ab3-b5d1-bf282113bfeb tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:51.670074 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b0a11982-2a1e-4ab3-b5d1-bf282113bfeb tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.265058 Dec 15 11:30:51.673754 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 69/136] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:51 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:51.682519 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-856b96af-02dd-4669-a4a8-08246f8459be req-e5f798db-1a1c-4648-8f2a-3c5b857c29fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ab2164-7f19-4c54-8e4e-91295c45a538", "tag": "038396f8-c2e8-482c-a9e9-cf23fb211312"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:51.684463 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:51.684463 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:30:51.695222 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-856b96af-02dd-4669-a4a8-08246f8459be req-e5f798db-1a1c-4648-8f2a-3c5b857c29fb service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:51.695838 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-856b96af-02dd-4669-a4a8-08246f8459be req-e5f798db-1a1c-4648-8f2a-3c5b857c29fb service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:51.707666 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-856b96af-02dd-4669-a4a8-08246f8459be req-e5f798db-1a1c-4648-8f2a-3c5b857c29fb service nova] Creating event network-changed:038396f8-c2e8-482c-a9e9-cf23fb211312 for instance 23ab2164-7f19-4c54-8e4e-91295c45a538 on hv-cinder-81321 Dec 15 11:30:51.714716 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-856b96af-02dd-4669-a4a8-08246f8459be req-e5f798db-1a1c-4648-8f2a-3c5b857c29fb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039417 Dec 15 11:30:51.715959 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 70/137] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:51.889155 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6fc1d877-f891-45da-addf-c7ca1e3b07ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:51.890432 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6fc1d877-f891-45da-addf-c7ca1e3b07ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:51.905575 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6fc1d877-f891-45da-addf-c7ca1e3b07ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:51.906253 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6fc1d877-f891-45da-addf-c7ca1e3b07ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:51.907672 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6fc1d877-f891-45da-addf-c7ca1e3b07ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:51.908430 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6fc1d877-f891-45da-addf-c7ca1e3b07ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:53.739552 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4557abcd-7178-40ce-9f56-3ee323f0f14b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 14 microversion: 2.1 time: 2.113947 Dec 15 11:30:53.741988 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 68/138] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:30:51 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 14 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:30:53.750119 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-769beed1-6324-474e-b921-932594c6feca req-235fc577-1f52-4393-af21-e8fdd2f756de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0866db17-45ec-4550-b834-8880e974be1d", "tag": "b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:53.753006 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:30:53.753006 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:30:53.756783 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6fc1d877-f891-45da-addf-c7ca1e3b07ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 14 microversion: 2.20 time: 1.871152 Dec 15 11:30:53.758400 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 71/139] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:30:51 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 14 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:53.767833 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-769beed1-6324-474e-b921-932594c6feca req-235fc577-1f52-4393-af21-e8fdd2f756de service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:53.769820 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2f5e1984-0524-4e5a-a115-a4f8364d0e61 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:53.771452 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2f5e1984-0524-4e5a-a115-a4f8364d0e61 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:53.782241 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-769beed1-6324-474e-b921-932594c6feca req-235fc577-1f52-4393-af21-e8fdd2f756de service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:53.787813 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f5e1984-0524-4e5a-a115-a4f8364d0e61 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:53.788878 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f5e1984-0524-4e5a-a115-a4f8364d0e61 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:53.790789 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f5e1984-0524-4e5a-a115-a4f8364d0e61 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:53.792238 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f5e1984-0524-4e5a-a115-a4f8364d0e61 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:53.830311 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-769beed1-6324-474e-b921-932594c6feca req-235fc577-1f52-4393-af21-e8fdd2f756de service nova] Creating event network-changed:b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d for instance 0866db17-45ec-4550-b834-8880e974be1d on hv-cinder-81321 Dec 15 11:30:53.844451 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-769beed1-6324-474e-b921-932594c6feca req-235fc577-1f52-4393-af21-e8fdd2f756de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100049 Dec 15 11:30:53.851734 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 69/140] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:30:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:30:54.212736 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2f5e1984-0524-4e5a-a115-a4f8364d0e61 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:54.220641 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2f5e1984-0524-4e5a-a115-a4f8364d0e61 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.460130 Dec 15 11:30:54.231706 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 72/141] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:53 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:54.426418 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3ff6d7fd-ad29-4ce6-8aa2-022325966539 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:54.427300 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3ff6d7fd-ad29-4ce6-8aa2-022325966539 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:54.436105 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3ff6d7fd-ad29-4ce6-8aa2-022325966539 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:54.436614 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3ff6d7fd-ad29-4ce6-8aa2-022325966539 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:54.437452 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3ff6d7fd-ad29-4ce6-8aa2-022325966539 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:54.438101 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3ff6d7fd-ad29-4ce6-8aa2-022325966539 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:54.469145 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3ff6d7fd-ad29-4ce6-8aa2-022325966539 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:30:54.573035 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3ff6d7fd-ad29-4ce6-8aa2-022325966539 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 204 len: 0 microversion: 2.1 time: 0.151712 Dec 15 11:30:54.573867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 70/142] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:30:54 2021] DELETE /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:30:54.581709 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f268f930-8a37-44e5-9cb4-3c25ddc387e5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:54.582327 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f268f930-8a37-44e5-9cb4-3c25ddc387e5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:54.589877 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f268f930-8a37-44e5-9cb4-3c25ddc387e5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:54.590542 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f268f930-8a37-44e5-9cb4-3c25ddc387e5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:54.591672 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f268f930-8a37-44e5-9cb4-3c25ddc387e5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:54.592276 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f268f930-8a37-44e5-9cb4-3c25ddc387e5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:54.752796 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bce60961-4add-4110-82d1-48dbc9ca98a5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:54.753696 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bce60961-4add-4110-82d1-48dbc9ca98a5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:54.761566 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bce60961-4add-4110-82d1-48dbc9ca98a5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:54.762012 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bce60961-4add-4110-82d1-48dbc9ca98a5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:54.763118 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bce60961-4add-4110-82d1-48dbc9ca98a5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:54.763227 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bce60961-4add-4110-82d1-48dbc9ca98a5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:54.831934 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bce60961-4add-4110-82d1-48dbc9ca98a5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 14 microversion: 2.1 time: 0.083006 Dec 15 11:30:54.834795 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 71/143] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:30:54 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 11:30:54.840521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3c7c5a5b-848d-4d80-bcc4-94f330384e03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:54.841527 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3c7c5a5b-848d-4d80-bcc4-94f330384e03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:54.849385 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c7c5a5b-848d-4d80-bcc4-94f330384e03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:54.850505 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c7c5a5b-848d-4d80-bcc4-94f330384e03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:54.851547 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c7c5a5b-848d-4d80-bcc4-94f330384e03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:54.851988 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c7c5a5b-848d-4d80-bcc4-94f330384e03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:54.933955 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3c7c5a5b-848d-4d80-bcc4-94f330384e03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 14 microversion: 2.20 time: 0.097374 Dec 15 11:30:54.937210 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 72/144] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:30:54 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:55.005027 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f268f930-8a37-44e5-9cb4-3c25ddc387e5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:55.013359 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f268f930-8a37-44e5-9cb4-3c25ddc387e5 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1554 microversion: 2.1 time: 0.435146 Dec 15 11:30:55.014142 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 73/145] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:54 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1554 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:55.238464 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6e00873b-cd65-4fa1-8ff3-abec2b0b3a65 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:55.239241 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6e00873b-cd65-4fa1-8ff3-abec2b0b3a65 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:55.246151 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e00873b-cd65-4fa1-8ff3-abec2b0b3a65 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:55.246639 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e00873b-cd65-4fa1-8ff3-abec2b0b3a65 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:55.247710 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e00873b-cd65-4fa1-8ff3-abec2b0b3a65 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:55.248362 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e00873b-cd65-4fa1-8ff3-abec2b0b3a65 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:55.434020 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6e00873b-cd65-4fa1-8ff3-abec2b0b3a65 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:55.441607 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6e00873b-cd65-4fa1-8ff3-abec2b0b3a65 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.207069 Dec 15 11:30:55.442255 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 73/146] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:55 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:55.843986 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b22d2d30-3f5b-4c3c-b2d8-09fb91ce61fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:55.845180 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b22d2d30-3f5b-4c3c-b2d8-09fb91ce61fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:55.852019 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b22d2d30-3f5b-4c3c-b2d8-09fb91ce61fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:55.852475 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b22d2d30-3f5b-4c3c-b2d8-09fb91ce61fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:55.853270 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b22d2d30-3f5b-4c3c-b2d8-09fb91ce61fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:55.853711 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b22d2d30-3f5b-4c3c-b2d8-09fb91ce61fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:55.927389 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b22d2d30-3f5b-4c3c-b2d8-09fb91ce61fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 14 microversion: 2.1 time: 0.086749 Dec 15 11:30:55.928666 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 74/147] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:30:55 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:30:55.944957 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-48b03341-73c8-44e3-b3ad-b53369d0e56d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:55.950848 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-48b03341-73c8-44e3-b3ad-b53369d0e56d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:55.957521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-48b03341-73c8-44e3-b3ad-b53369d0e56d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:55.958129 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-48b03341-73c8-44e3-b3ad-b53369d0e56d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:55.959143 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-48b03341-73c8-44e3-b3ad-b53369d0e56d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:55.960101 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-48b03341-73c8-44e3-b3ad-b53369d0e56d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:56.036323 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7abb06a8-ed2b-4194-8534-df48fe4ef59f tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:56.038608 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7abb06a8-ed2b-4194-8534-df48fe4ef59f tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:56.046260 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7abb06a8-ed2b-4194-8534-df48fe4ef59f tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:56.046858 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7abb06a8-ed2b-4194-8534-df48fe4ef59f tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:56.047766 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7abb06a8-ed2b-4194-8534-df48fe4ef59f tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:56.048437 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7abb06a8-ed2b-4194-8534-df48fe4ef59f tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:56.049958 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-48b03341-73c8-44e3-b3ad-b53369d0e56d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 14 microversion: 2.20 time: 0.109301 Dec 15 11:30:56.055382 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 74/148] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:30:55 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:56.203509 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7abb06a8-ed2b-4194-8534-df48fe4ef59f tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:56.213252 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7abb06a8-ed2b-4194-8534-df48fe4ef59f tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1554 microversion: 2.1 time: 0.185223 Dec 15 11:30:56.236828 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 75/149] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:56 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:56.459751 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-23b38e38-ecaf-447e-99f9-99a1ff5c052e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:56.460431 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-23b38e38-ecaf-447e-99f9-99a1ff5c052e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:56.466800 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23b38e38-ecaf-447e-99f9-99a1ff5c052e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:56.467237 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23b38e38-ecaf-447e-99f9-99a1ff5c052e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:56.468001 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23b38e38-ecaf-447e-99f9-99a1ff5c052e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:56.468423 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23b38e38-ecaf-447e-99f9-99a1ff5c052e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:56.609961 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-23b38e38-ecaf-447e-99f9-99a1ff5c052e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:56.617666 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-23b38e38-ecaf-447e-99f9-99a1ff5c052e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.162359 Dec 15 11:30:56.618283 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 75/150] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:56 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:56.939743 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-68439fcb-6003-49d3-b707-ba5bcd5a55f7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:56.941683 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-68439fcb-6003-49d3-b707-ba5bcd5a55f7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:56.958092 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-68439fcb-6003-49d3-b707-ba5bcd5a55f7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:56.958545 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-68439fcb-6003-49d3-b707-ba5bcd5a55f7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:56.960454 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-68439fcb-6003-49d3-b707-ba5bcd5a55f7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:56.961031 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-68439fcb-6003-49d3-b707-ba5bcd5a55f7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:57.062310 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ad7d2b93-596e-484e-8be5-b1b0c899dc70 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:30:57.063400 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ad7d2b93-596e-484e-8be5-b1b0c899dc70 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:57.070883 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad7d2b93-596e-484e-8be5-b1b0c899dc70 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:57.071276 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad7d2b93-596e-484e-8be5-b1b0c899dc70 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:57.072414 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad7d2b93-596e-484e-8be5-b1b0c899dc70 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:57.072917 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad7d2b93-596e-484e-8be5-b1b0c899dc70 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:59.509736 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ad7d2b93-596e-484e-8be5-b1b0c899dc70 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 14 microversion: 2.20 time: 2.450871 Dec 15 11:30:59.513396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 76/151] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:30:57 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 14 bytes in 2452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:30:59.515383 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8b864235-8c00-430e-9db4-9447e40bc484 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:59.516110 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8b864235-8c00-430e-9db4-9447e40bc484 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:59.523833 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b864235-8c00-430e-9db4-9447e40bc484 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:59.524279 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b864235-8c00-430e-9db4-9447e40bc484 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:59.525245 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b864235-8c00-430e-9db4-9447e40bc484 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:59.525681 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b864235-8c00-430e-9db4-9447e40bc484 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:59.526962 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-68439fcb-6003-49d3-b707-ba5bcd5a55f7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 14 microversion: 2.1 time: 2.590945 Dec 15 11:30:59.527863 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 76/152] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:30:56 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 14 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:30:59.532917 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-80f8e2dd-986b-4d92-b2f0-65bf3b0afbb0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:30:59.533776 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-80f8e2dd-986b-4d92-b2f0-65bf3b0afbb0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:30:59.541575 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-80f8e2dd-986b-4d92-b2f0-65bf3b0afbb0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:59.542033 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-80f8e2dd-986b-4d92-b2f0-65bf3b0afbb0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:59.542821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-80f8e2dd-986b-4d92-b2f0-65bf3b0afbb0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:30:59.543252 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-80f8e2dd-986b-4d92-b2f0-65bf3b0afbb0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:30:59.688695 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-80f8e2dd-986b-4d92-b2f0-65bf3b0afbb0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:59.696664 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-80f8e2dd-986b-4d92-b2f0-65bf3b0afbb0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.167478 Dec 15 11:30:59.697397 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 77/153] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:59 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:30:59.837131 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8b864235-8c00-430e-9db4-9447e40bc484 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:30:59.844871 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8b864235-8c00-430e-9db4-9447e40bc484 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1554 microversion: 2.1 time: 0.333197 Dec 15 11:30:59.845427 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 77/154] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:30:59 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1554 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:00.520844 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d73fa290-af29-45ab-b985-c14cce79a36d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:00.521897 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d73fa290-af29-45ab-b985-c14cce79a36d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:00.528137 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d73fa290-af29-45ab-b985-c14cce79a36d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:00.528668 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d73fa290-af29-45ab-b985-c14cce79a36d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:00.529381 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d73fa290-af29-45ab-b985-c14cce79a36d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:00.529820 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d73fa290-af29-45ab-b985-c14cce79a36d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:00.536951 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3d3903b0-73ec-458e-8869-6ff98c14741d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:00.538723 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3d3903b0-73ec-458e-8869-6ff98c14741d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:00.545534 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3d3903b0-73ec-458e-8869-6ff98c14741d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:00.545974 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3d3903b0-73ec-458e-8869-6ff98c14741d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:00.546770 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3d3903b0-73ec-458e-8869-6ff98c14741d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:00.547206 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3d3903b0-73ec-458e-8869-6ff98c14741d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:03.138835 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3d3903b0-73ec-458e-8869-6ff98c14741d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 14 microversion: 2.1 time: 2.605253 Dec 15 11:31:03.139535 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 78/155] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:00 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 14 bytes in 2607 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 11:31:03.142530 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d73fa290-af29-45ab-b985-c14cce79a36d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 14 microversion: 2.20 time: 2.625216 Dec 15 11:31:03.143315 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 78/156] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:00 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 14 bytes in 2627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:03.144516 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-94cfecd8-140c-4fa6-915a-13a52c84f88b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:03.145232 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-94cfecd8-140c-4fa6-915a-13a52c84f88b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:03.148219 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b2cfbbfe-01a7-40a6-bd19-10d779902c07 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:03.148911 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b2cfbbfe-01a7-40a6-bd19-10d779902c07 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:03.152016 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-94cfecd8-140c-4fa6-915a-13a52c84f88b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:03.152456 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-94cfecd8-140c-4fa6-915a-13a52c84f88b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:03.153225 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-94cfecd8-140c-4fa6-915a-13a52c84f88b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:03.153684 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-94cfecd8-140c-4fa6-915a-13a52c84f88b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:03.155636 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b2cfbbfe-01a7-40a6-bd19-10d779902c07 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:03.157120 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b2cfbbfe-01a7-40a6-bd19-10d779902c07 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:03.157934 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b2cfbbfe-01a7-40a6-bd19-10d779902c07 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:03.158379 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b2cfbbfe-01a7-40a6-bd19-10d779902c07 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:03.296014 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b2cfbbfe-01a7-40a6-bd19-10d779902c07 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:03.299635 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-94cfecd8-140c-4fa6-915a-13a52c84f88b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:03.304190 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b2cfbbfe-01a7-40a6-bd19-10d779902c07 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1554 microversion: 2.1 time: 0.159892 Dec 15 11:31:03.304757 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 79/157] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:03 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:03.307291 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-94cfecd8-140c-4fa6-915a-13a52c84f88b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.166444 Dec 15 11:31:03.307934 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 79/158] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:03 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:03.571662 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-185ac904-d856-4e5a-8634-51a75cb874eb req-5ee71d46-2b71-486c-92af-f4f1ec13bdd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab993417-eae4-48a0-9763-2c0c1556db1f", "name": "network-vif-unplugged", "status": "completed", "tag": "26bc01c0-2c54-4374-81f7-c18e91531b66"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:03.573412 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:31:03.573412 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:31:03.588923 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-185ac904-d856-4e5a-8634-51a75cb874eb req-5ee71d46-2b71-486c-92af-f4f1ec13bdd9 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:03.589389 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-185ac904-d856-4e5a-8634-51a75cb874eb req-5ee71d46-2b71-486c-92af-f4f1ec13bdd9 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:03.604070 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-185ac904-d856-4e5a-8634-51a75cb874eb req-5ee71d46-2b71-486c-92af-f4f1ec13bdd9 service nova] Creating event network-vif-unplugged:26bc01c0-2c54-4374-81f7-c18e91531b66 for instance ab993417-eae4-48a0-9763-2c0c1556db1f on hv-cinder-81321 Dec 15 11:31:03.609597 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-185ac904-d856-4e5a-8634-51a75cb874eb req-5ee71d46-2b71-486c-92af-f4f1ec13bdd9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043637 Dec 15 11:31:03.610190 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 80/159] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:31:03 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:31:03.855818 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-db180659-8a60-4a03-8c72-be79a9941b7c req-a03e2b28-5882-47d0-890d-d9d56f514447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab993417-eae4-48a0-9763-2c0c1556db1f", "name": "network-vif-deleted", "tag": "26bc01c0-2c54-4374-81f7-c18e91531b66"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:03.857309 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:31:03.857309 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:31:03.864455 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-db180659-8a60-4a03-8c72-be79a9941b7c req-a03e2b28-5882-47d0-890d-d9d56f514447 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:03.864898 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-db180659-8a60-4a03-8c72-be79a9941b7c req-a03e2b28-5882-47d0-890d-d9d56f514447 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:03.875311 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-db180659-8a60-4a03-8c72-be79a9941b7c req-a03e2b28-5882-47d0-890d-d9d56f514447 service nova] Creating event network-vif-deleted:26bc01c0-2c54-4374-81f7-c18e91531b66 for instance ab993417-eae4-48a0-9763-2c0c1556db1f on hv-cinder-81321 Dec 15 11:31:03.880053 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-db180659-8a60-4a03-8c72-be79a9941b7c req-a03e2b28-5882-47d0-890d-d9d56f514447 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027801 Dec 15 11:31:03.880607 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 80/160] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:31:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:31:04.150937 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d98ec15a-2a3b-4353-8314-feb871141560 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:04.151923 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d98ec15a-2a3b-4353-8314-feb871141560 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:04.154388 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-87b9d38c-181f-4986-83e3-94db9f345716 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:04.155439 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-87b9d38c-181f-4986-83e3-94db9f345716 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:04.158021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d98ec15a-2a3b-4353-8314-feb871141560 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:04.158460 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d98ec15a-2a3b-4353-8314-feb871141560 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:04.159255 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d98ec15a-2a3b-4353-8314-feb871141560 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:04.159682 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d98ec15a-2a3b-4353-8314-feb871141560 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:04.161345 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-87b9d38c-181f-4986-83e3-94db9f345716 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:04.161828 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-87b9d38c-181f-4986-83e3-94db9f345716 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:04.163290 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-87b9d38c-181f-4986-83e3-94db9f345716 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:04.163723 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-87b9d38c-181f-4986-83e3-94db9f345716 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:06.760062 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d98ec15a-2a3b-4353-8314-feb871141560 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 14 microversion: 2.1 time: 2.613892 Dec 15 11:31:06.760732 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 81/161] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:04 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 14 bytes in 2616 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:31:06.765489 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2ed9f536-88a2-4367-95e9-b1cd0b3e041b tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:06.766175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2ed9f536-88a2-4367-95e9-b1cd0b3e041b tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:06.771360 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-87b9d38c-181f-4986-83e3-94db9f345716 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 14 microversion: 2.20 time: 2.621227 Dec 15 11:31:06.772113 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 81/162] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:04 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 14 bytes in 2623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:31:06.773405 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2ed9f536-88a2-4367-95e9-b1cd0b3e041b tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:06.774038 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2ed9f536-88a2-4367-95e9-b1cd0b3e041b tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:06.774942 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2ed9f536-88a2-4367-95e9-b1cd0b3e041b tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:06.775370 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2ed9f536-88a2-4367-95e9-b1cd0b3e041b tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:06.777770 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-dfd238e2-cf82-4604-a1aa-aef5d307c8fa tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:06.778955 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-dfd238e2-cf82-4604-a1aa-aef5d307c8fa tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:06.785515 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfd238e2-cf82-4604-a1aa-aef5d307c8fa tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:06.785959 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfd238e2-cf82-4604-a1aa-aef5d307c8fa tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:06.786894 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfd238e2-cf82-4604-a1aa-aef5d307c8fa tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:06.787962 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfd238e2-cf82-4604-a1aa-aef5d307c8fa tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:06.840241 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2ed9f536-88a2-4367-95e9-b1cd0b3e041b tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:06.848654 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2ed9f536-88a2-4367-95e9-b1cd0b3e041b tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1346 microversion: 2.1 time: 0.086834 Dec 15 11:31:06.849397 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 82/163] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:06 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:06.924215 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-dfd238e2-cf82-4604-a1aa-aef5d307c8fa tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:06.931600 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-dfd238e2-cf82-4604-a1aa-aef5d307c8fa tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.158171 Dec 15 11:31:06.932156 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 82/164] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:06 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:07.770789 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-72cd6686-d94d-4c8f-9719-c02ade46954b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:07.771707 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-72cd6686-d94d-4c8f-9719-c02ade46954b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:07.778302 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-72cd6686-d94d-4c8f-9719-c02ade46954b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:07.778859 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-72cd6686-d94d-4c8f-9719-c02ade46954b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:07.779569 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-72cd6686-d94d-4c8f-9719-c02ade46954b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:07.779995 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-72cd6686-d94d-4c8f-9719-c02ade46954b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:07.782622 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-21b7c7e6-1f2d-4a31-912a-9c204c14ef74 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:07.783672 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-21b7c7e6-1f2d-4a31-912a-9c204c14ef74 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:07.790257 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21b7c7e6-1f2d-4a31-912a-9c204c14ef74 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:07.790869 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21b7c7e6-1f2d-4a31-912a-9c204c14ef74 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:07.792056 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21b7c7e6-1f2d-4a31-912a-9c204c14ef74 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:07.792565 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21b7c7e6-1f2d-4a31-912a-9c204c14ef74 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:07.865312 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-21b7c7e6-1f2d-4a31-912a-9c204c14ef74 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 14 microversion: 2.20 time: 0.085207 Dec 15 11:31:07.865312 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 83/165] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:07 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:07.871647 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0d979efe-4a5a-4535-a1e7-e1a575f9d448 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:07.872211 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-72cd6686-d94d-4c8f-9719-c02ade46954b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 14 microversion: 2.1 time: 0.104154 Dec 15 11:31:07.872450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0d979efe-4a5a-4535-a1e7-e1a575f9d448 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:07.873701 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 83/166] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:07 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:31:07.887227 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d979efe-4a5a-4535-a1e7-e1a575f9d448 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:07.888084 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d979efe-4a5a-4535-a1e7-e1a575f9d448 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:07.889212 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d979efe-4a5a-4535-a1e7-e1a575f9d448 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:07.889782 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d979efe-4a5a-4535-a1e7-e1a575f9d448 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:07.936214 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d979efe-4a5a-4535-a1e7-e1a575f9d448 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:07.936911 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d979efe-4a5a-4535-a1e7-e1a575f9d448 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:07.937466 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-0d979efe-4a5a-4535-a1e7-e1a575f9d448 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lazy-loading 'fault' on Instance uuid ab993417-eae4-48a0-9763-2c0c1556db1f {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:31:07.949470 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-cb5ed7dd-fdbe-419b-90f8-bb46f00dc7f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:07.950402 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-cb5ed7dd-fdbe-419b-90f8-bb46f00dc7f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:07.959818 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cb5ed7dd-fdbe-419b-90f8-bb46f00dc7f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:07.961130 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cb5ed7dd-fdbe-419b-90f8-bb46f00dc7f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:07.962374 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cb5ed7dd-fdbe-419b-90f8-bb46f00dc7f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:07.963020 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cb5ed7dd-fdbe-419b-90f8-bb46f00dc7f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:08.016658 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0d979efe-4a5a-4535-a1e7-e1a575f9d448 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beedd26d2ca345b1a0d2de50592f7989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de29c0e3e6994463a6c1ab2757e07810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:08.039551 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0d979efe-4a5a-4535-a1e7-e1a575f9d448 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 200 len: 1351 microversion: 2.1 time: 0.170156 Dec 15 11:31:08.040257 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 84/167] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:07 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 1351 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:08.128461 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-cb5ed7dd-fdbe-419b-90f8-bb46f00dc7f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:08.137805 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-cb5ed7dd-fdbe-419b-90f8-bb46f00dc7f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.193173 Dec 15 11:31:08.138806 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 84/168] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:07 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:31:08.875287 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-15880d54-1c23-4bfa-8847-a4ddebf5d196 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:08.876310 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-15880d54-1c23-4bfa-8847-a4ddebf5d196 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:08.884577 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15880d54-1c23-4bfa-8847-a4ddebf5d196 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:08.885112 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15880d54-1c23-4bfa-8847-a4ddebf5d196 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:08.885428 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7a7a67a0-adfb-40be-8bca-a7fab78a51a7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:08.886061 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15880d54-1c23-4bfa-8847-a4ddebf5d196 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:08.886593 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15880d54-1c23-4bfa-8847-a4ddebf5d196 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:08.888010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7a7a67a0-adfb-40be-8bca-a7fab78a51a7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:08.903971 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7a7a67a0-adfb-40be-8bca-a7fab78a51a7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:08.904579 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7a7a67a0-adfb-40be-8bca-a7fab78a51a7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:08.906539 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7a7a67a0-adfb-40be-8bca-a7fab78a51a7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:08.907050 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7a7a67a0-adfb-40be-8bca-a7fab78a51a7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:08.966481 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-15880d54-1c23-4bfa-8847-a4ddebf5d196 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 14 microversion: 2.20 time: 0.094746 Dec 15 11:31:08.967299 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 85/169] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:08 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:08.991004 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7a7a67a0-adfb-40be-8bca-a7fab78a51a7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 221 microversion: 2.1 time: 0.110683 Dec 15 11:31:08.991883 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 85/170] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:08 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:31:09.057828 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e23ad56e-b8f9-4a90-80c7-d559bfe33250 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:09.058536 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e23ad56e-b8f9-4a90-80c7-d559bfe33250 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:09.065976 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e23ad56e-b8f9-4a90-80c7-d559bfe33250 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:09.066439 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e23ad56e-b8f9-4a90-80c7-d559bfe33250 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:09.067252 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e23ad56e-b8f9-4a90-80c7-d559bfe33250 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:09.067679 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e23ad56e-b8f9-4a90-80c7-d559bfe33250 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:09.084461 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-e23ad56e-b8f9-4a90-80c7-d559bfe33250 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] HTTP exception thrown: Instance ab993417-eae4-48a0-9763-2c0c1556db1f could not be found. Dec 15 11:31:09.085227 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e23ad56e-b8f9-4a90-80c7-d559bfe33250 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Returning 404 to user: Instance ab993417-eae4-48a0-9763-2c0c1556db1f could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:31:09.086114 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e23ad56e-b8f9-4a90-80c7-d559bfe33250 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 404 len: 111 microversion: 2.1 time: 0.033301 Dec 15 11:31:09.087574 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 86/171] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:09 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:31:09.154546 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e3ee46ae-1c2c-4219-b67f-9fb871d6d7ab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:09.155184 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e3ee46ae-1c2c-4219-b67f-9fb871d6d7ab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:09.162813 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e3ee46ae-1c2c-4219-b67f-9fb871d6d7ab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:09.163553 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e3ee46ae-1c2c-4219-b67f-9fb871d6d7ab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:09.164713 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e3ee46ae-1c2c-4219-b67f-9fb871d6d7ab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:09.165352 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e3ee46ae-1c2c-4219-b67f-9fb871d6d7ab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:09.262170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1ceae28a-699b-4e7f-8f31-d5aaa09d12e0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:09.263425 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1ceae28a-699b-4e7f-8f31-d5aaa09d12e0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:09.270914 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ceae28a-699b-4e7f-8f31-d5aaa09d12e0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:09.272011 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ceae28a-699b-4e7f-8f31-d5aaa09d12e0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:09.273965 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ceae28a-699b-4e7f-8f31-d5aaa09d12e0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:09.274409 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ceae28a-699b-4e7f-8f31-d5aaa09d12e0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:09.290940 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-1ceae28a-699b-4e7f-8f31-d5aaa09d12e0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] HTTP exception thrown: Instance ab993417-eae4-48a0-9763-2c0c1556db1f could not be found. Dec 15 11:31:09.291923 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1ceae28a-699b-4e7f-8f31-d5aaa09d12e0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Returning 404 to user: Instance ab993417-eae4-48a0-9763-2c0c1556db1f could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:31:09.292910 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1ceae28a-699b-4e7f-8f31-d5aaa09d12e0 tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034926 Dec 15 11:31:09.293670 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 87/172] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:31:09 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:31:09.324575 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e3ee46ae-1c2c-4219-b67f-9fb871d6d7ab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:09.334995 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e3ee46ae-1c2c-4219-b67f-9fb871d6d7ab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.182254 Dec 15 11:31:09.334995 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 86/173] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:09 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:09.977229 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4264784f-4bfd-4921-afe7-af44762ff374 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:09.978134 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4264784f-4bfd-4921-afe7-af44762ff374 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:09.984419 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4264784f-4bfd-4921-afe7-af44762ff374 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:09.984856 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4264784f-4bfd-4921-afe7-af44762ff374 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:09.985619 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4264784f-4bfd-4921-afe7-af44762ff374 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:09.986043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4264784f-4bfd-4921-afe7-af44762ff374 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:10.001456 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-70f849d4-81a0-440d-926a-3e00af02e471 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:10.002495 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-70f849d4-81a0-440d-926a-3e00af02e471 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:10.009693 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-70f849d4-81a0-440d-926a-3e00af02e471 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:10.010142 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-70f849d4-81a0-440d-926a-3e00af02e471 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:10.010964 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-70f849d4-81a0-440d-926a-3e00af02e471 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:10.011403 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-70f849d4-81a0-440d-926a-3e00af02e471 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:10.063626 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4264784f-4bfd-4921-afe7-af44762ff374 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 7493 microversion: 2.20 time: 0.089977 Dec 15 11:31:10.064278 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 88/174] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:09 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 7493 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:31:10.093372 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-70f849d4-81a0-440d-926a-3e00af02e471 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 8006 microversion: 2.1 time: 0.095517 Dec 15 11:31:10.094025 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 87/175] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:09 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 8006 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:31:10.351572 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-60652b9b-a782-442c-b0bb-e0e1d324beec tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:10.352635 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-60652b9b-a782-442c-b0bb-e0e1d324beec tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:10.360311 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60652b9b-a782-442c-b0bb-e0e1d324beec tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:10.360768 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60652b9b-a782-442c-b0bb-e0e1d324beec tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:10.361735 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60652b9b-a782-442c-b0bb-e0e1d324beec tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:10.362258 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60652b9b-a782-442c-b0bb-e0e1d324beec tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:10.506717 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-60652b9b-a782-442c-b0bb-e0e1d324beec tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:10.515144 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-60652b9b-a782-442c-b0bb-e0e1d324beec tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.167856 Dec 15 11:31:10.515752 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 89/176] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:10 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:10.534132 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b0010692-488f-42ba-b43e-414431ad6eac tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:10.534817 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b0010692-488f-42ba-b43e-414431ad6eac tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:10.541982 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b0010692-488f-42ba-b43e-414431ad6eac tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:10.542425 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b0010692-488f-42ba-b43e-414431ad6eac tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:10.543215 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b0010692-488f-42ba-b43e-414431ad6eac tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:10.543650 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b0010692-488f-42ba-b43e-414431ad6eac tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:10.558984 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-b0010692-488f-42ba-b43e-414431ad6eac tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] HTTP exception thrown: Instance ab993417-eae4-48a0-9763-2c0c1556db1f could not be found. Dec 15 11:31:10.559570 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b0010692-488f-42ba-b43e-414431ad6eac tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Returning 404 to user: Instance ab993417-eae4-48a0-9763-2c0c1556db1f could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:31:10.560378 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b0010692-488f-42ba-b43e-414431ad6eac tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 404 len: 111 microversion: 2.1 time: 0.030210 Dec 15 11:31:10.560909 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 88/177] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:31:10 2021] DELETE /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:31:10.568823 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f28ad30b-c9dd-43e3-b89f-bd06ab928b1a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:10.569549 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f28ad30b-c9dd-43e3-b89f-bd06ab928b1a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] [instance: ab993417-eae4-48a0-9763-2c0c1556db1f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:10.576522 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f28ad30b-c9dd-43e3-b89f-bd06ab928b1a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:10.576831 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f28ad30b-c9dd-43e3-b89f-bd06ab928b1a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:10.577629 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f28ad30b-c9dd-43e3-b89f-bd06ab928b1a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:10.578097 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f28ad30b-c9dd-43e3-b89f-bd06ab928b1a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:10.593373 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-f28ad30b-c9dd-43e3-b89f-bd06ab928b1a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] HTTP exception thrown: Instance ab993417-eae4-48a0-9763-2c0c1556db1f could not be found. Dec 15 11:31:10.594052 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f28ad30b-c9dd-43e3-b89f-bd06ab928b1a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] Returning 404 to user: Instance ab993417-eae4-48a0-9763-2c0c1556db1f could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:31:10.594918 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f28ad30b-c9dd-43e3-b89f-bd06ab928b1a tempest-DeleteServersTestJSON-1064239402 tempest-DeleteServersTestJSON-1064239402-project] 10.222.0.18 "GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f" status: 404 len: 111 microversion: 2.1 time: 0.029902 Dec 15 11:31:10.595448 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 90/178] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:10 2021] GET /compute/v2.1/servers/ab993417-eae4-48a0-9763-2c0c1556db1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:31:11.075182 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e6bb8cfd-82d3-4319-8507-5ab02c1b7faa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:11.076172 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e6bb8cfd-82d3-4319-8507-5ab02c1b7faa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:11.083064 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6bb8cfd-82d3-4319-8507-5ab02c1b7faa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:11.083623 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6bb8cfd-82d3-4319-8507-5ab02c1b7faa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:11.084498 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6bb8cfd-82d3-4319-8507-5ab02c1b7faa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:11.085041 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6bb8cfd-82d3-4319-8507-5ab02c1b7faa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:11.105797 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ecab2940-628f-4f6f-a4ac-d98305f5ded0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:11.106819 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ecab2940-628f-4f6f-a4ac-d98305f5ded0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:11.118972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ecab2940-628f-4f6f-a4ac-d98305f5ded0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:11.120754 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ecab2940-628f-4f6f-a4ac-d98305f5ded0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:11.121990 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ecab2940-628f-4f6f-a4ac-d98305f5ded0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:11.122424 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ecab2940-628f-4f6f-a4ac-d98305f5ded0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:11.180624 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e6bb8cfd-82d3-4319-8507-5ab02c1b7faa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 14631 microversion: 2.20 time: 0.109172 Dec 15 11:31:11.181423 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 89/179] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:11 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 14631 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:11.210901 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ecab2940-628f-4f6f-a4ac-d98305f5ded0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 15025 microversion: 2.1 time: 0.110211 Dec 15 11:31:11.212185 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 91/180] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:11 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 15025 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:11.533229 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-478b76e0-b436-46ec-a66b-8cbbcd373f6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:11.534309 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-478b76e0-b436-46ec-a66b-8cbbcd373f6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:11.546397 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-478b76e0-b436-46ec-a66b-8cbbcd373f6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:11.547103 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-478b76e0-b436-46ec-a66b-8cbbcd373f6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:11.555398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-478b76e0-b436-46ec-a66b-8cbbcd373f6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:11.555847 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-478b76e0-b436-46ec-a66b-8cbbcd373f6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:11.747044 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-478b76e0-b436-46ec-a66b-8cbbcd373f6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:11.756259 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-478b76e0-b436-46ec-a66b-8cbbcd373f6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.226866 Dec 15 11:31:11.756981 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 90/181] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:11 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:12.199699 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-89c6e9c3-0689-4ad9-844e-c38f145188d8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:12.201451 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-89c6e9c3-0689-4ad9-844e-c38f145188d8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:12.208175 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89c6e9c3-0689-4ad9-844e-c38f145188d8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:12.208775 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89c6e9c3-0689-4ad9-844e-c38f145188d8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:12.209652 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89c6e9c3-0689-4ad9-844e-c38f145188d8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:12.210170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89c6e9c3-0689-4ad9-844e-c38f145188d8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:12.224279 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a4894304-6cb2-484a-ac34-dd08b400bc31 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:12.227525 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a4894304-6cb2-484a-ac34-dd08b400bc31 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:12.237208 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a4894304-6cb2-484a-ac34-dd08b400bc31 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:12.238659 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a4894304-6cb2-484a-ac34-dd08b400bc31 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:12.239871 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a4894304-6cb2-484a-ac34-dd08b400bc31 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:12.240485 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a4894304-6cb2-484a-ac34-dd08b400bc31 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:12.321979 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-89c6e9c3-0689-4ad9-844e-c38f145188d8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 17602 microversion: 2.20 time: 0.127288 Dec 15 11:31:12.322637 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 92/182] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:12 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 17602 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:12.347205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a4894304-6cb2-484a-ac34-dd08b400bc31 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 17960 microversion: 2.1 time: 0.126659 Dec 15 11:31:12.348124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 91/183] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:12 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 17960 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:12.651385 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-40a95cad-a256-48a8-a460-ad1805abe6d4 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Action: 'create', calling method: .version_select at 0x7fdf59b97790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-498277236", "metadata": {"Type": "work"}}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:12.652906 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-40a95cad-a256-48a8-a460-ad1805abe6d4 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:31:12.653764 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-40a95cad-a256-48a8-a460-ad1805abe6d4 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.225764 Dec 15 11:31:12.654359 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 93/184] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Dec 15 11:31:12 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 11:31:12.664161 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-17bafc53-e14b-4c60-898a-309cb1fdf674 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Action: 'create', calling method: .version_select at 0x7fdf59c12ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-488039793", "metadata": {"Type": "work"}}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:12.665691 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-17bafc53-e14b-4c60-898a-309cb1fdf674 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:31:12.666550 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-17bafc53-e14b-4c60-898a-309cb1fdf674 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006778 Dec 15 11:31:12.667123 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 92/185] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Dec 15 11:31:12 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 11:31:12.675793 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-39276d9b-1d19-4d43-aac8-f5e1371711aa tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Action: 'create', calling method: .version_select at 0x7fdf59b97040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-602190156", "metadata": {"Type": "work"}}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:12.676937 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-39276d9b-1d19-4d43-aac8-f5e1371711aa tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:31:12.677710 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-39276d9b-1d19-4d43-aac8-f5e1371711aa tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005535 Dec 15 11:31:12.678208 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 94/186] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Dec 15 11:31:12 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 11:31:12.687096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a7d69255-8edd-4b94-a659-5d1f0ed6d26d tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Calling method '.version_select at 0x7fdf59bc9d30>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:12.716147 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-a7d69255-8edd-4b94-a659-5d1f0ed6d26d tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] HTTP exception thrown: Volume tempest-invalid-2126465772 could not be found. Dec 15 11:31:12.716736 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a7d69255-8edd-4b94-a659-5d1f0ed6d26d tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Returning 404 to user: Volume tempest-invalid-2126465772 could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:31:12.717544 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a7d69255-8edd-4b94-a659-5d1f0ed6d26d tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2126465772" status: 404 len: 99 microversion: 2.1 time: 0.034488 Dec 15 11:31:12.718098 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 93/187] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Dec 15 11:31:12 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-2126465772 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 15 11:31:12.727488 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-995239ad-503b-4348-8c17-d19c2d631bf5 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004011 Dec 15 11:31:12.728204 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 95/188] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Dec 15 11:31:12 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 11:31:12.736750 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-93339ee3-b8a0-4b18-b280-e77b6ec533f7 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004014 Dec 15 11:31:12.737298 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 94/189] 10.222.0.18 () {58 vars in 1136 bytes} [Wed Dec 15 11:31:12 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 11:31:12.746407 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-da0dba5e-edcf-49fc-af96-2c259565bd68 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Calling method '.version_select at 0x7fdf59b33670>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:12.774103 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-da0dba5e-edcf-49fc-af96-2c259565bd68 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] HTTP exception thrown: Volume 53d81768-7586-4b9c-bee5-63235c0b4ba3 could not be found. Dec 15 11:31:12.774735 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-da0dba5e-edcf-49fc-af96-2c259565bd68 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Returning 404 to user: Volume 53d81768-7586-4b9c-bee5-63235c0b4ba3 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:31:12.775571 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-da0dba5e-edcf-49fc-af96-2c259565bd68 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/53d81768-7586-4b9c-bee5-63235c0b4ba3" status: 404 len: 109 microversion: 2.1 time: 0.033310 Dec 15 11:31:12.775763 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-9834f3df-22dd-4899-a21d-c723643a147b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:12.776119 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 96/190] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 11:31:12 2021] DELETE /compute/v2.1/os-volumes/53d81768-7586-4b9c-bee5-63235c0b4ba3 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:31:12.780846 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-9834f3df-22dd-4899-a21d-c723643a147b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:12.784769 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e151aa7b-5b16-4b53-9ea7-8880e8414700 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Calling method '.version_select at 0x7fdf59b979d0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:12.787657 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9834f3df-22dd-4899-a21d-c723643a147b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:12.788104 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9834f3df-22dd-4899-a21d-c723643a147b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:12.789022 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9834f3df-22dd-4899-a21d-c723643a147b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:12.789463 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9834f3df-22dd-4899-a21d-c723643a147b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:12.814076 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-e151aa7b-5b16-4b53-9ea7-8880e8414700 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] HTTP exception thrown: Volume 6a069753-d96b-4f1f-aade-b904cd1c9e2f could not be found. Dec 15 11:31:12.814651 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e151aa7b-5b16-4b53-9ea7-8880e8414700 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] Returning 404 to user: Volume 6a069753-d96b-4f1f-aade-b904cd1c9e2f could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:31:12.815808 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e151aa7b-5b16-4b53-9ea7-8880e8414700 tempest-VolumesNegativeTest-1345969779 tempest-VolumesNegativeTest-1345969779-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6a069753-d96b-4f1f-aade-b904cd1c9e2f" status: 404 len: 109 microversion: 2.1 time: 0.034616 Dec 15 11:31:12.816383 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 97/191] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:31:12 2021] GET /compute/v2.1/os-volumes/6a069753-d96b-4f1f-aade-b904cd1c9e2f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:31:12.930689 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9834f3df-22dd-4899-a21d-c723643a147b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:12.944580 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-9834f3df-22dd-4899-a21d-c723643a147b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.173121 Dec 15 11:31:12.946134 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 95/192] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:12 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:13.336419 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fb62156c-6837-4ac6-971a-8c793740155b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:13.338024 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fb62156c-6837-4ac6-971a-8c793740155b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:13.345483 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fb62156c-6837-4ac6-971a-8c793740155b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:13.346271 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fb62156c-6837-4ac6-971a-8c793740155b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:13.347596 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fb62156c-6837-4ac6-971a-8c793740155b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:13.348135 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fb62156c-6837-4ac6-971a-8c793740155b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:13.359755 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-bb24c852-82d6-4fc8-aca1-7756161cb8cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:13.360729 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-bb24c852-82d6-4fc8-aca1-7756161cb8cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:13.371061 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bb24c852-82d6-4fc8-aca1-7756161cb8cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:13.371517 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bb24c852-82d6-4fc8-aca1-7756161cb8cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:13.376391 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bb24c852-82d6-4fc8-aca1-7756161cb8cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:13.377021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bb24c852-82d6-4fc8-aca1-7756161cb8cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:13.427463 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fb62156c-6837-4ac6-971a-8c793740155b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 17602 microversion: 2.20 time: 0.094095 Dec 15 11:31:13.431643 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 98/193] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:13 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 17602 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:13.502178 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-bb24c852-82d6-4fc8-aca1-7756161cb8cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 18155 microversion: 2.1 time: 0.146073 Dec 15 11:31:13.502864 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 96/194] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:13 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 18155 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:13.972261 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9d432536-ee21-4506-9281-8898ca930144 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:13.973217 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9d432536-ee21-4506-9281-8898ca930144 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:13.981552 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9d432536-ee21-4506-9281-8898ca930144 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:13.981977 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9d432536-ee21-4506-9281-8898ca930144 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:13.983024 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9d432536-ee21-4506-9281-8898ca930144 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:13.983613 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9d432536-ee21-4506-9281-8898ca930144 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:14.166939 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9d432536-ee21-4506-9281-8898ca930144 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:14.174226 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9d432536-ee21-4506-9281-8898ca930144 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.206964 Dec 15 11:31:14.178614 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 99/195] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:13 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:14.438869 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f979665d-e7a1-4823-b2b1-d69e33bc62d7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:14.439844 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f979665d-e7a1-4823-b2b1-d69e33bc62d7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:14.447465 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f979665d-e7a1-4823-b2b1-d69e33bc62d7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:14.447914 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f979665d-e7a1-4823-b2b1-d69e33bc62d7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:14.448703 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f979665d-e7a1-4823-b2b1-d69e33bc62d7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:14.449137 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f979665d-e7a1-4823-b2b1-d69e33bc62d7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:14.513572 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-477e2594-1e22-406c-8001-f6432e8bf2d0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:14.514549 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-477e2594-1e22-406c-8001-f6432e8bf2d0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:14.521127 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-477e2594-1e22-406c-8001-f6432e8bf2d0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:14.521572 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-477e2594-1e22-406c-8001-f6432e8bf2d0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:14.522470 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-477e2594-1e22-406c-8001-f6432e8bf2d0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:14.523475 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-477e2594-1e22-406c-8001-f6432e8bf2d0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:16.544506 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f979665d-e7a1-4823-b2b1-d69e33bc62d7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 21931 microversion: 2.20 time: 2.109604 Dec 15 11:31:16.545275 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 97/196] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:14 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 21931 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:16.550397 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-11448aac-4418-4704-b3c6-cf12ddc9b8af tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:16.551124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-11448aac-4418-4704-b3c6-cf12ddc9b8af tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:16.560587 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11448aac-4418-4704-b3c6-cf12ddc9b8af tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:16.561041 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11448aac-4418-4704-b3c6-cf12ddc9b8af tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:16.562270 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11448aac-4418-4704-b3c6-cf12ddc9b8af tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:16.562753 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11448aac-4418-4704-b3c6-cf12ddc9b8af tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:16.568242 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-477e2594-1e22-406c-8001-f6432e8bf2d0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 22752 microversion: 2.1 time: 2.058309 Dec 15 11:31:16.573218 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 100/197] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:14 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 22752 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:16.698123 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-11448aac-4418-4704-b3c6-cf12ddc9b8af tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:16.705449 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-11448aac-4418-4704-b3c6-cf12ddc9b8af tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.158795 Dec 15 11:31:16.706011 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 98/198] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:16 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:17.557456 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-75b70166-a4d0-4d17-aee0-89191ea236fe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:17.558707 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-75b70166-a4d0-4d17-aee0-89191ea236fe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:17.565746 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-75b70166-a4d0-4d17-aee0-89191ea236fe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:17.566266 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-75b70166-a4d0-4d17-aee0-89191ea236fe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:17.567168 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-75b70166-a4d0-4d17-aee0-89191ea236fe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:17.567673 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-75b70166-a4d0-4d17-aee0-89191ea236fe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:17.580588 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c8240436-1081-4128-8d2c-4bf867b2c0cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:17.581632 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c8240436-1081-4128-8d2c-4bf867b2c0cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:17.591756 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c8240436-1081-4128-8d2c-4bf867b2c0cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:17.592334 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c8240436-1081-4128-8d2c-4bf867b2c0cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:17.593239 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c8240436-1081-4128-8d2c-4bf867b2c0cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:17.593763 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c8240436-1081-4128-8d2c-4bf867b2c0cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:19.810168 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-75b70166-a4d0-4d17-aee0-89191ea236fe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 26134 microversion: 2.20 time: 2.257549 Dec 15 11:31:19.811260 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 101/199] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:17 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 26134 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:19.815915 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8b4865ff-95b3-40b1-9242-883ec9f2d1e5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:19.816640 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8b4865ff-95b3-40b1-9242-883ec9f2d1e5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:19.824060 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b4865ff-95b3-40b1-9242-883ec9f2d1e5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:19.824506 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b4865ff-95b3-40b1-9242-883ec9f2d1e5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:19.824801 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c8240436-1081-4128-8d2c-4bf867b2c0cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 26023 microversion: 2.1 time: 2.247683 Dec 15 11:31:19.825280 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b4865ff-95b3-40b1-9242-883ec9f2d1e5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:19.828688 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b4865ff-95b3-40b1-9242-883ec9f2d1e5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:19.828820 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 99/200] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:17 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 26023 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:19.955830 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8b4865ff-95b3-40b1-9242-883ec9f2d1e5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:19.964449 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8b4865ff-95b3-40b1-9242-883ec9f2d1e5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.152151 Dec 15 11:31:19.965004 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 102/201] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:19 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:20.821929 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b67fcaec-667c-473e-9135-43be814b5fb8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:20.823009 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b67fcaec-667c-473e-9135-43be814b5fb8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:20.830128 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b67fcaec-667c-473e-9135-43be814b5fb8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:20.830750 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b67fcaec-667c-473e-9135-43be814b5fb8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:20.831468 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b67fcaec-667c-473e-9135-43be814b5fb8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:20.831908 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b67fcaec-667c-473e-9135-43be814b5fb8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:20.837559 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-07a30f26-4ac7-4f33-a095-84b458b5e82b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:20.839205 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-07a30f26-4ac7-4f33-a095-84b458b5e82b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:20.844989 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-07a30f26-4ac7-4f33-a095-84b458b5e82b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:20.845442 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-07a30f26-4ac7-4f33-a095-84b458b5e82b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:20.846482 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-07a30f26-4ac7-4f33-a095-84b458b5e82b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:20.846808 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-07a30f26-4ac7-4f33-a095-84b458b5e82b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:20.915494 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b67fcaec-667c-473e-9135-43be814b5fb8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 26799 microversion: 2.20 time: 0.096795 Dec 15 11:31:20.916521 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 100/202] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:20 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 26799 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:20.935285 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-07a30f26-4ac7-4f33-a095-84b458b5e82b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 26758 microversion: 2.1 time: 0.100968 Dec 15 11:31:20.935285 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 103/203] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:20 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 26758 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:20.982206 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c13260e8-b625-4f63-aaff-598df27dc9c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:20.982938 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c13260e8-b625-4f63-aaff-598df27dc9c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:20.989483 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c13260e8-b625-4f63-aaff-598df27dc9c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:20.989935 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c13260e8-b625-4f63-aaff-598df27dc9c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:20.990738 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c13260e8-b625-4f63-aaff-598df27dc9c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:20.991175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c13260e8-b625-4f63-aaff-598df27dc9c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:21.156373 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c13260e8-b625-4f63-aaff-598df27dc9c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:21.164502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c13260e8-b625-4f63-aaff-598df27dc9c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.186255 Dec 15 11:31:21.165879 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 101/204] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:20 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:21.928529 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6ce75939-6caf-4fa5-825a-56cbcf12370a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:21.929537 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6ce75939-6caf-4fa5-825a-56cbcf12370a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:21.937098 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ce75939-6caf-4fa5-825a-56cbcf12370a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:21.937542 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ce75939-6caf-4fa5-825a-56cbcf12370a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:21.938365 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ce75939-6caf-4fa5-825a-56cbcf12370a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:21.938827 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ce75939-6caf-4fa5-825a-56cbcf12370a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:21.945124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-19ec4d72-68af-4c04-9731-aae676e2ce1c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:21.946239 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-19ec4d72-68af-4c04-9731-aae676e2ce1c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:21.952607 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-19ec4d72-68af-4c04-9731-aae676e2ce1c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:21.953057 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-19ec4d72-68af-4c04-9731-aae676e2ce1c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:21.953848 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-19ec4d72-68af-4c04-9731-aae676e2ce1c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:21.954313 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-19ec4d72-68af-4c04-9731-aae676e2ce1c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:22.030988 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6ce75939-6caf-4fa5-825a-56cbcf12370a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 27331 microversion: 2.20 time: 0.107745 Dec 15 11:31:22.031613 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 104/205] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:21 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 27331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:22.051383 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-19ec4d72-68af-4c04-9731-aae676e2ce1c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 27517 microversion: 2.1 time: 0.109802 Dec 15 11:31:22.052010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 102/206] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:21 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 27517 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:22.182494 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b3aa3c2f-8969-410e-8c5c-791c2939a1c2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:22.183230 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b3aa3c2f-8969-410e-8c5c-791c2939a1c2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:22.190412 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3aa3c2f-8969-410e-8c5c-791c2939a1c2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:22.190885 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3aa3c2f-8969-410e-8c5c-791c2939a1c2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:22.191771 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3aa3c2f-8969-410e-8c5c-791c2939a1c2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:22.192209 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3aa3c2f-8969-410e-8c5c-791c2939a1c2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:22.337099 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b3aa3c2f-8969-410e-8c5c-791c2939a1c2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:22.351694 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b3aa3c2f-8969-410e-8c5c-791c2939a1c2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.173237 Dec 15 11:31:22.352963 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 105/207] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:22 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:23.043927 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-28298d15-8196-4e2b-a31f-637722824e5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:23.046002 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-28298d15-8196-4e2b-a31f-637722824e5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:23.055594 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-28298d15-8196-4e2b-a31f-637722824e5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:23.056289 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-28298d15-8196-4e2b-a31f-637722824e5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:23.057143 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-28298d15-8196-4e2b-a31f-637722824e5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:23.057669 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-28298d15-8196-4e2b-a31f-637722824e5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:23.063271 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6c63e4c1-bf30-4059-988d-1226cead5203 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:23.064868 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6c63e4c1-bf30-4059-988d-1226cead5203 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:23.076658 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c63e4c1-bf30-4059-988d-1226cead5203 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:23.077421 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c63e4c1-bf30-4059-988d-1226cead5203 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:23.082801 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c63e4c1-bf30-4059-988d-1226cead5203 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:23.083440 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c63e4c1-bf30-4059-988d-1226cead5203 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:23.213529 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-28298d15-8196-4e2b-a31f-637722824e5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 27615 microversion: 2.20 time: 0.174255 Dec 15 11:31:23.219143 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 103/208] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:23 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 27615 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:23.251390 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6c63e4c1-bf30-4059-988d-1226cead5203 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 27816 microversion: 2.1 time: 0.191334 Dec 15 11:31:23.256342 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 106/209] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:23 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 27816 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:23.369952 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-12875ffa-64d1-49ba-b2c0-5062f2fab81a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:23.370932 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-12875ffa-64d1-49ba-b2c0-5062f2fab81a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:23.377988 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-12875ffa-64d1-49ba-b2c0-5062f2fab81a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:23.378930 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-12875ffa-64d1-49ba-b2c0-5062f2fab81a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:23.379726 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-12875ffa-64d1-49ba-b2c0-5062f2fab81a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:23.380160 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-12875ffa-64d1-49ba-b2c0-5062f2fab81a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:23.595021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-12875ffa-64d1-49ba-b2c0-5062f2fab81a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:23.604364 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-12875ffa-64d1-49ba-b2c0-5062f2fab81a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.238624 Dec 15 11:31:23.605246 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 104/210] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:23 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:24.226301 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8aa03381-1e2e-455c-91ba-b97c7764c9a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:24.228169 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8aa03381-1e2e-455c-91ba-b97c7764c9a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:24.235019 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8aa03381-1e2e-455c-91ba-b97c7764c9a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:24.235459 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8aa03381-1e2e-455c-91ba-b97c7764c9a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:24.236232 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8aa03381-1e2e-455c-91ba-b97c7764c9a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:24.236654 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8aa03381-1e2e-455c-91ba-b97c7764c9a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:24.263397 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-1fe1ce40-289b-49b3-b220-426b6b016d50 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:24.264306 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-1fe1ce40-289b-49b3-b220-426b6b016d50 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:24.284442 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1fe1ce40-289b-49b3-b220-426b6b016d50 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:24.284970 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1fe1ce40-289b-49b3-b220-426b6b016d50 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:24.287502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1fe1ce40-289b-49b3-b220-426b6b016d50 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:24.287914 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1fe1ce40-289b-49b3-b220-426b6b016d50 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:24.353326 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8aa03381-1e2e-455c-91ba-b97c7764c9a8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 27804 microversion: 2.20 time: 0.131174 Dec 15 11:31:24.354084 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 107/211] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:24 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 27804 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:24.388629 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-1fe1ce40-289b-49b3-b220-426b6b016d50 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 27998 microversion: 2.1 time: 0.128603 Dec 15 11:31:24.389284 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 105/212] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:24 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 27998 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:24.622283 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-39f05256-a8ff-49fd-9827-4585abb39f4b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:24.623201 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-39f05256-a8ff-49fd-9827-4585abb39f4b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:24.631225 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-39f05256-a8ff-49fd-9827-4585abb39f4b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:24.634499 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-39f05256-a8ff-49fd-9827-4585abb39f4b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:24.639621 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-39f05256-a8ff-49fd-9827-4585abb39f4b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:24.640068 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-39f05256-a8ff-49fd-9827-4585abb39f4b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:24.937980 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-39f05256-a8ff-49fd-9827-4585abb39f4b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:24.955698 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-39f05256-a8ff-49fd-9827-4585abb39f4b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1521 microversion: 2.1 time: 0.333480 Dec 15 11:31:24.962867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 108/213] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:24 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:25.365011 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8de494e8-c652-4c63-a7a3-042086397598 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:25.366251 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8de494e8-c652-4c63-a7a3-042086397598 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:25.373387 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8de494e8-c652-4c63-a7a3-042086397598 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:25.373833 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8de494e8-c652-4c63-a7a3-042086397598 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:25.374661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8de494e8-c652-4c63-a7a3-042086397598 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:25.375124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8de494e8-c652-4c63-a7a3-042086397598 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:25.402424 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1b331de9-20e0-4a6c-8765-1a7532418f5c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:25.403406 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1b331de9-20e0-4a6c-8765-1a7532418f5c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:25.410754 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b331de9-20e0-4a6c-8765-1a7532418f5c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:25.411516 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b331de9-20e0-4a6c-8765-1a7532418f5c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:25.412494 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b331de9-20e0-4a6c-8765-1a7532418f5c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:25.413106 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b331de9-20e0-4a6c-8765-1a7532418f5c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:25.465210 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8de494e8-c652-4c63-a7a3-042086397598 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 28219 microversion: 2.20 time: 0.104006 Dec 15 11:31:25.466677 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 106/214] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:25 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 28219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:25.525599 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1b331de9-20e0-4a6c-8765-1a7532418f5c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 28184 microversion: 2.1 time: 0.128160 Dec 15 11:31:25.527837 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 109/215] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:25 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 28184 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:25.973614 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-356b23cd-8736-443f-a991-4b2a6e6ed1a1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:25.974593 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-356b23cd-8736-443f-a991-4b2a6e6ed1a1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:25.981582 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-356b23cd-8736-443f-a991-4b2a6e6ed1a1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:25.982230 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-356b23cd-8736-443f-a991-4b2a6e6ed1a1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:25.983033 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-356b23cd-8736-443f-a991-4b2a6e6ed1a1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:25.983456 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-356b23cd-8736-443f-a991-4b2a6e6ed1a1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:26.186434 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-356b23cd-8736-443f-a991-4b2a6e6ed1a1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:26.200469 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-356b23cd-8736-443f-a991-4b2a6e6ed1a1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1501 microversion: 2.1 time: 0.230713 Dec 15 11:31:26.204030 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 107/216] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:25 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1501 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:26.220609 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ac300d4c-d54c-48f5-bafc-cae04086c89e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:26.221540 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ac300d4c-d54c-48f5-bafc-cae04086c89e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:26.229806 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac300d4c-d54c-48f5-bafc-cae04086c89e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:26.230245 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac300d4c-d54c-48f5-bafc-cae04086c89e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:26.231050 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac300d4c-d54c-48f5-bafc-cae04086c89e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:26.231682 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac300d4c-d54c-48f5-bafc-cae04086c89e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:26.453321 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ac300d4c-d54c-48f5-bafc-cae04086c89e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:26.461998 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ac300d4c-d54c-48f5-bafc-cae04086c89e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1513 microversion: 2.1 time: 0.244621 Dec 15 11:31:26.462379 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 110/217] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:26 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:26.479210 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0b09b4d1-a5a4-4b67-b10d-c186e489c1ef tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:26.480343 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-0b09b4d1-a5a4-4b67-b10d-c186e489c1ef tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:26.489116 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0b09b4d1-a5a4-4b67-b10d-c186e489c1ef tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:26.489730 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0b09b4d1-a5a4-4b67-b10d-c186e489c1ef tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:26.491172 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0b09b4d1-a5a4-4b67-b10d-c186e489c1ef tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:26.491601 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0b09b4d1-a5a4-4b67-b10d-c186e489c1ef tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:26.538439 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f27ff2ba-6391-4c35-9b5b-cc60efc55460 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:26.539421 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f27ff2ba-6391-4c35-9b5b-cc60efc55460 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:26.546781 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f27ff2ba-6391-4c35-9b5b-cc60efc55460 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:26.547441 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f27ff2ba-6391-4c35-9b5b-cc60efc55460 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:26.548403 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f27ff2ba-6391-4c35-9b5b-cc60efc55460 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:26.548840 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f27ff2ba-6391-4c35-9b5b-cc60efc55460 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:26.601222 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0b09b4d1-a5a4-4b67-b10d-c186e489c1ef tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 28219 microversion: 2.20 time: 0.126184 Dec 15 11:31:26.603563 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 108/218] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:26 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 28219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:26.636751 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f27ff2ba-6391-4c35-9b5b-cc60efc55460 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 28184 microversion: 2.1 time: 0.102268 Dec 15 11:31:26.637580 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 111/219] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:26 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 28184 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:27.615749 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c2ed6857-8636-4d7a-ac93-34bdc500b851 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:27.617209 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c2ed6857-8636-4d7a-ac93-34bdc500b851 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:27.625223 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c2ed6857-8636-4d7a-ac93-34bdc500b851 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:27.625783 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c2ed6857-8636-4d7a-ac93-34bdc500b851 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:27.626718 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c2ed6857-8636-4d7a-ac93-34bdc500b851 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:27.627254 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c2ed6857-8636-4d7a-ac93-34bdc500b851 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:27.649474 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6ef756d2-d41b-4a12-884b-c2b307be6b7c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:27.650762 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6ef756d2-d41b-4a12-884b-c2b307be6b7c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:27.660778 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ef756d2-d41b-4a12-884b-c2b307be6b7c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:27.661441 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ef756d2-d41b-4a12-884b-c2b307be6b7c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:27.662214 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ef756d2-d41b-4a12-884b-c2b307be6b7c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:27.662830 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ef756d2-d41b-4a12-884b-c2b307be6b7c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:27.722535 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c2ed6857-8636-4d7a-ac93-34bdc500b851 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 28428 microversion: 2.20 time: 0.110548 Dec 15 11:31:27.723670 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 109/220] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:27 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 28428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:31:27.776028 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6ef756d2-d41b-4a12-884b-c2b307be6b7c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 28310 microversion: 2.1 time: 0.129825 Dec 15 11:31:27.781556 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 112/221] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:27 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 28310 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:28.023710 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fc6ff692-cea3-40fe-887f-6ef09be17767 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:28.024736 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fc6ff692-cea3-40fe-887f-6ef09be17767 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:28.031786 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc6ff692-cea3-40fe-887f-6ef09be17767 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:28.032288 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc6ff692-cea3-40fe-887f-6ef09be17767 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:28.033097 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc6ff692-cea3-40fe-887f-6ef09be17767 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:28.033618 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc6ff692-cea3-40fe-887f-6ef09be17767 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:28.060732 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-fc6ff692-cea3-40fe-887f-6ef09be17767 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lazy-loading 'flavor' on Instance uuid 9c2f09d7-6122-484a-b99c-33d451ae87a9 {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:31:28.136045 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fc6ff692-cea3-40fe-887f-6ef09be17767 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/action" status: 200 len: 32 microversion: 2.1 time: 0.117959 Dec 15 11:31:28.136880 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 110/222] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:28 2021] POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/action => generated 32 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:31:28.146107 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b87ca0c5-618b-4b88-931a-8c7bda427482 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:28.147075 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b87ca0c5-618b-4b88-931a-8c7bda427482 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:28.154548 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b87ca0c5-618b-4b88-931a-8c7bda427482 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:28.155242 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b87ca0c5-618b-4b88-931a-8c7bda427482 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:28.156226 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b87ca0c5-618b-4b88-931a-8c7bda427482 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:28.156665 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b87ca0c5-618b-4b88-931a-8c7bda427482 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:28.374552 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b87ca0c5-618b-4b88-931a-8c7bda427482 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:28.385261 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b87ca0c5-618b-4b88-931a-8c7bda427482 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.242905 Dec 15 11:31:28.386091 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 113/223] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:28 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:28.736420 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-97a52b16-d931-4529-89ea-73b74900ecc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:28.737416 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-97a52b16-d931-4529-89ea-73b74900ecc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:28.743792 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-97a52b16-d931-4529-89ea-73b74900ecc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:28.745222 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-97a52b16-d931-4529-89ea-73b74900ecc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:28.746197 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-97a52b16-d931-4529-89ea-73b74900ecc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:28.746837 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-97a52b16-d931-4529-89ea-73b74900ecc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:28.790651 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-322769a6-0ea0-4b1f-b3ac-d9866be59d57 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:28.791634 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-322769a6-0ea0-4b1f-b3ac-d9866be59d57 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:28.797972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-322769a6-0ea0-4b1f-b3ac-d9866be59d57 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:28.798417 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-322769a6-0ea0-4b1f-b3ac-d9866be59d57 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:28.799246 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-322769a6-0ea0-4b1f-b3ac-d9866be59d57 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:28.799678 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-322769a6-0ea0-4b1f-b3ac-d9866be59d57 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:28.843097 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-97a52b16-d931-4529-89ea-73b74900ecc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 28507 microversion: 2.20 time: 0.111229 Dec 15 11:31:28.844080 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 111/224] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:28 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 28507 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:28.916806 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-322769a6-0ea0-4b1f-b3ac-d9866be59d57 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 28473 microversion: 2.1 time: 0.129009 Dec 15 11:31:28.920995 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 114/225] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:28 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 28473 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:29.407967 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2737ca33-1fb4-4d42-a0bf-a6279e6642d3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:29.409043 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2737ca33-1fb4-4d42-a0bf-a6279e6642d3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:29.417268 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2737ca33-1fb4-4d42-a0bf-a6279e6642d3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:29.417721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2737ca33-1fb4-4d42-a0bf-a6279e6642d3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:29.418525 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2737ca33-1fb4-4d42-a0bf-a6279e6642d3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:29.419007 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2737ca33-1fb4-4d42-a0bf-a6279e6642d3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:29.647854 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2737ca33-1fb4-4d42-a0bf-a6279e6642d3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:29.656688 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2737ca33-1fb4-4d42-a0bf-a6279e6642d3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.256695 Dec 15 11:31:29.660724 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 112/226] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:29 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:31:29.859269 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-59b001a9-a60d-495e-b941-e5eba0a80ffe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:29.862868 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-59b001a9-a60d-495e-b941-e5eba0a80ffe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:29.879161 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-59b001a9-a60d-495e-b941-e5eba0a80ffe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:29.879919 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-59b001a9-a60d-495e-b941-e5eba0a80ffe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:29.881054 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-59b001a9-a60d-495e-b941-e5eba0a80ffe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:29.881688 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-59b001a9-a60d-495e-b941-e5eba0a80ffe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:29.928168 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-299cdf6e-1f4c-477a-a506-9522784aa225 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:29.929781 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-299cdf6e-1f4c-477a-a506-9522784aa225 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:29.940451 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-299cdf6e-1f4c-477a-a506-9522784aa225 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:29.941261 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-299cdf6e-1f4c-477a-a506-9522784aa225 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:29.943530 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-299cdf6e-1f4c-477a-a506-9522784aa225 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:29.944228 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-299cdf6e-1f4c-477a-a506-9522784aa225 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:30.013442 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-59b001a9-a60d-495e-b941-e5eba0a80ffe tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 28674 microversion: 2.20 time: 0.160627 Dec 15 11:31:30.014340 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 115/227] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:29 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 28674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:30.050701 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-299cdf6e-1f4c-477a-a506-9522784aa225 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 28641 microversion: 2.1 time: 0.126230 Dec 15 11:31:30.051992 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 113/228] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:29 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 28641 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:30.677733 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5fe73056-cc56-4b94-af69-308301239c7f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:30.678538 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5fe73056-cc56-4b94-af69-308301239c7f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:30.686551 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5fe73056-cc56-4b94-af69-308301239c7f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:30.687129 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5fe73056-cc56-4b94-af69-308301239c7f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:30.687986 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5fe73056-cc56-4b94-af69-308301239c7f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:30.688516 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5fe73056-cc56-4b94-af69-308301239c7f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:30.840997 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5fe73056-cc56-4b94-af69-308301239c7f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:30.849592 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5fe73056-cc56-4b94-af69-308301239c7f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.175782 Dec 15 11:31:30.850349 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 116/229] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:30 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:31.025661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3a74f470-964e-48fc-ab9f-2b83e10e707d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:31.026842 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3a74f470-964e-48fc-ab9f-2b83e10e707d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:31.033497 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3a74f470-964e-48fc-ab9f-2b83e10e707d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:31.034130 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3a74f470-964e-48fc-ab9f-2b83e10e707d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:31.035094 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3a74f470-964e-48fc-ab9f-2b83e10e707d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:31.035699 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3a74f470-964e-48fc-ab9f-2b83e10e707d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:31.063636 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2627cc2b-9c37-42f9-ad2f-12833852fdb5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:31.065152 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2627cc2b-9c37-42f9-ad2f-12833852fdb5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:31.089477 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2627cc2b-9c37-42f9-ad2f-12833852fdb5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:31.090855 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2627cc2b-9c37-42f9-ad2f-12833852fdb5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:31.093778 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2627cc2b-9c37-42f9-ad2f-12833852fdb5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:31.095468 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2627cc2b-9c37-42f9-ad2f-12833852fdb5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:31.149615 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3a74f470-964e-48fc-ab9f-2b83e10e707d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 28674 microversion: 2.20 time: 0.127702 Dec 15 11:31:31.150300 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 114/230] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:31 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 28674 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:31.189116 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2627cc2b-9c37-42f9-ad2f-12833852fdb5 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 28641 microversion: 2.1 time: 0.128902 Dec 15 11:31:31.190887 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 117/231] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:31 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 28641 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:31.869925 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-75b5e873-6f0e-4ef0-8bb5-78931b11321b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:31.871010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-75b5e873-6f0e-4ef0-8bb5-78931b11321b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:31.878231 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-75b5e873-6f0e-4ef0-8bb5-78931b11321b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:31.879089 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-75b5e873-6f0e-4ef0-8bb5-78931b11321b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:31.880034 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-75b5e873-6f0e-4ef0-8bb5-78931b11321b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:31.880463 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-75b5e873-6f0e-4ef0-8bb5-78931b11321b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:32.079596 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-75b5e873-6f0e-4ef0-8bb5-78931b11321b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:32.087219 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-75b5e873-6f0e-4ef0-8bb5-78931b11321b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.222391 Dec 15 11:31:32.088368 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 115/232] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:31 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:32.162033 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4d61a515-e7b9-4014-9fef-558028a05824 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:32.163423 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4d61a515-e7b9-4014-9fef-558028a05824 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:32.180086 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4d61a515-e7b9-4014-9fef-558028a05824 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:32.180086 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4d61a515-e7b9-4014-9fef-558028a05824 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:32.180086 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4d61a515-e7b9-4014-9fef-558028a05824 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:32.180086 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4d61a515-e7b9-4014-9fef-558028a05824 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:32.201026 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-02b5538f-77f1-4d4a-93ad-e35940ae122b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:32.201970 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-02b5538f-77f1-4d4a-93ad-e35940ae122b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:32.215915 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-02b5538f-77f1-4d4a-93ad-e35940ae122b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:32.216360 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-02b5538f-77f1-4d4a-93ad-e35940ae122b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:32.217143 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-02b5538f-77f1-4d4a-93ad-e35940ae122b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:32.217572 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-02b5538f-77f1-4d4a-93ad-e35940ae122b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:32.268111 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4d61a515-e7b9-4014-9fef-558028a05824 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 28674 microversion: 2.20 time: 0.110161 Dec 15 11:31:32.269510 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 118/233] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:32 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 28674 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:32.310487 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-02b5538f-77f1-4d4a-93ad-e35940ae122b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 28641 microversion: 2.1 time: 0.113051 Dec 15 11:31:32.311868 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 116/234] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:32 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 28641 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:33.105376 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6e3dde96-f788-4a2e-9039-a5221d92fb34 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:33.106077 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6e3dde96-f788-4a2e-9039-a5221d92fb34 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:33.113008 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e3dde96-f788-4a2e-9039-a5221d92fb34 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:33.113453 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e3dde96-f788-4a2e-9039-a5221d92fb34 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:33.114239 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e3dde96-f788-4a2e-9039-a5221d92fb34 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:33.114697 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e3dde96-f788-4a2e-9039-a5221d92fb34 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:33.282369 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b1fef067-fb65-4a4c-8465-4ae771d1b3d3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:33.283560 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b1fef067-fb65-4a4c-8465-4ae771d1b3d3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:33.290326 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b1fef067-fb65-4a4c-8465-4ae771d1b3d3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:33.290800 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b1fef067-fb65-4a4c-8465-4ae771d1b3d3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:33.291587 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b1fef067-fb65-4a4c-8465-4ae771d1b3d3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:33.292735 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b1fef067-fb65-4a4c-8465-4ae771d1b3d3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:33.295977 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6e3dde96-f788-4a2e-9039-a5221d92fb34 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:33.303388 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6e3dde96-f788-4a2e-9039-a5221d92fb34 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.202919 Dec 15 11:31:33.303940 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 119/235] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:33 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:33.323103 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-831d7424-6aa5-4df2-8999-5f4d4799939f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:33.324005 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-831d7424-6aa5-4df2-8999-5f4d4799939f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:33.329705 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-831d7424-6aa5-4df2-8999-5f4d4799939f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:33.330140 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-831d7424-6aa5-4df2-8999-5f4d4799939f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:33.330936 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-831d7424-6aa5-4df2-8999-5f4d4799939f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:33.331364 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-831d7424-6aa5-4df2-8999-5f4d4799939f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:33.373439 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b1fef067-fb65-4a4c-8465-4ae771d1b3d3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 28674 microversion: 2.20 time: 0.095019 Dec 15 11:31:33.374000 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 117/236] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:33 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 28674 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:31:33.400334 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-831d7424-6aa5-4df2-8999-5f4d4799939f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 28641 microversion: 2.1 time: 0.080515 Dec 15 11:31:33.401633 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 120/237] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:33 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 28641 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:34.320843 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-991d9f98-1f85-4acf-90dc-7a01bf0d6919 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:34.321632 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-991d9f98-1f85-4acf-90dc-7a01bf0d6919 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:34.328333 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-991d9f98-1f85-4acf-90dc-7a01bf0d6919 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:34.328784 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-991d9f98-1f85-4acf-90dc-7a01bf0d6919 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:34.329561 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-991d9f98-1f85-4acf-90dc-7a01bf0d6919 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:34.329994 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-991d9f98-1f85-4acf-90dc-7a01bf0d6919 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:34.384554 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-54ee44c0-4c0c-4c95-8b21-a2731e3793f6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:34.386395 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-54ee44c0-4c0c-4c95-8b21-a2731e3793f6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:34.393319 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54ee44c0-4c0c-4c95-8b21-a2731e3793f6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:34.393895 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54ee44c0-4c0c-4c95-8b21-a2731e3793f6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:34.394815 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54ee44c0-4c0c-4c95-8b21-a2731e3793f6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:34.395326 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54ee44c0-4c0c-4c95-8b21-a2731e3793f6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:34.686339 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-991d9f98-1f85-4acf-90dc-7a01bf0d6919 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:34.693652 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-991d9f98-1f85-4acf-90dc-7a01bf0d6919 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.376718 Dec 15 11:31:34.694212 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 118/238] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:34 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:34.698933 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d387fef6-a452-4a99-8984-2fa074a1d0d8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:34.700298 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d387fef6-a452-4a99-8984-2fa074a1d0d8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:34.705948 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d387fef6-a452-4a99-8984-2fa074a1d0d8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:34.706392 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d387fef6-a452-4a99-8984-2fa074a1d0d8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:34.707199 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d387fef6-a452-4a99-8984-2fa074a1d0d8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:34.707630 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d387fef6-a452-4a99-8984-2fa074a1d0d8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:37.329046 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-54ee44c0-4c0c-4c95-8b21-a2731e3793f6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 32148 microversion: 2.20 time: 2.948064 Dec 15 11:31:37.330174 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 121/239] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:34 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 32148 bytes in 2950 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:31:37.332976 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d387fef6-a452-4a99-8984-2fa074a1d0d8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 28641 microversion: 2.1 time: 2.637500 Dec 15 11:31:37.333811 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 119/240] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:34 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 28641 bytes in 2639 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:37.335014 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-72d4ff6a-a651-4ec9-8dbb-a2288d35a765 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:37.335700 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-72d4ff6a-a651-4ec9-8dbb-a2288d35a765 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:37.343414 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-72d4ff6a-a651-4ec9-8dbb-a2288d35a765 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:37.343901 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-72d4ff6a-a651-4ec9-8dbb-a2288d35a765 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:37.344666 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-72d4ff6a-a651-4ec9-8dbb-a2288d35a765 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:37.345091 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-72d4ff6a-a651-4ec9-8dbb-a2288d35a765 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:37.478852 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-72d4ff6a-a651-4ec9-8dbb-a2288d35a765 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:37.489270 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-72d4ff6a-a651-4ec9-8dbb-a2288d35a765 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.157146 Dec 15 11:31:37.489868 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 122/241] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:37 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:38.342998 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d4630553-d032-4ccf-8458-158cacac28b0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:38.344255 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d4630553-d032-4ccf-8458-158cacac28b0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:38.346106 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4743f40e-5188-4a2f-a19a-ff138c593464 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:38.347269 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4743f40e-5188-4a2f-a19a-ff138c593464 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:38.351174 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d4630553-d032-4ccf-8458-158cacac28b0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:38.351676 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d4630553-d032-4ccf-8458-158cacac28b0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:38.353060 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d4630553-d032-4ccf-8458-158cacac28b0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:38.353539 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d4630553-d032-4ccf-8458-158cacac28b0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:38.355972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4743f40e-5188-4a2f-a19a-ff138c593464 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:38.356567 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4743f40e-5188-4a2f-a19a-ff138c593464 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:38.358491 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4743f40e-5188-4a2f-a19a-ff138c593464 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:38.359531 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4743f40e-5188-4a2f-a19a-ff138c593464 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:38.451220 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d4630553-d032-4ccf-8458-158cacac28b0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 33069 microversion: 2.20 time: 0.113488 Dec 15 11:31:38.451869 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 120/242] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:38 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 33069 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:31:38.473628 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4743f40e-5188-4a2f-a19a-ff138c593464 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 29967 microversion: 2.1 time: 0.131424 Dec 15 11:31:38.474323 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 123/243] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:38 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 29967 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:38.507260 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-85277967-a542-44ea-9c25-549e223d4bc9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:38.507961 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-85277967-a542-44ea-9c25-549e223d4bc9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:38.515789 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85277967-a542-44ea-9c25-549e223d4bc9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:38.516236 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85277967-a542-44ea-9c25-549e223d4bc9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:38.517030 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85277967-a542-44ea-9c25-549e223d4bc9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:38.517460 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85277967-a542-44ea-9c25-549e223d4bc9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:38.665688 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-85277967-a542-44ea-9c25-549e223d4bc9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:38.673502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-85277967-a542-44ea-9c25-549e223d4bc9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.170527 Dec 15 11:31:38.674067 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 121/244] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:38 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:31:39.464123 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-419cc395-0271-43f4-9577-bedafee8dc1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:39.465120 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-419cc395-0271-43f4-9577-bedafee8dc1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:39.471882 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-419cc395-0271-43f4-9577-bedafee8dc1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:39.472322 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-419cc395-0271-43f4-9577-bedafee8dc1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:39.473089 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-419cc395-0271-43f4-9577-bedafee8dc1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:39.473513 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-419cc395-0271-43f4-9577-bedafee8dc1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:39.486127 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fc0a74cc-7b69-47a3-a356-6cce19debb37 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:39.487730 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fc0a74cc-7b69-47a3-a356-6cce19debb37 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:39.497315 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc0a74cc-7b69-47a3-a356-6cce19debb37 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:39.497764 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc0a74cc-7b69-47a3-a356-6cce19debb37 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:39.498545 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc0a74cc-7b69-47a3-a356-6cce19debb37 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:39.499008 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc0a74cc-7b69-47a3-a356-6cce19debb37 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:41.538521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-419cc395-0271-43f4-9577-bedafee8dc1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 35939 microversion: 2.20 time: 2.078648 Dec 15 11:31:41.542622 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 124/245] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:39 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 35939 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:41.544185 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-421f3d0f-735d-4ea8-bd55-ea6a50962616 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:41.544875 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-421f3d0f-735d-4ea8-bd55-ea6a50962616 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:41.552322 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-421f3d0f-735d-4ea8-bd55-ea6a50962616 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:41.552770 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-421f3d0f-735d-4ea8-bd55-ea6a50962616 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:41.553537 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-421f3d0f-735d-4ea8-bd55-ea6a50962616 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:41.553968 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-421f3d0f-735d-4ea8-bd55-ea6a50962616 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:41.555158 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fc0a74cc-7b69-47a3-a356-6cce19debb37 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 33800 microversion: 2.1 time: 2.072881 Dec 15 11:31:41.558485 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 122/246] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:39 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 33800 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:41.686402 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-421f3d0f-735d-4ea8-bd55-ea6a50962616 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:41.694168 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-421f3d0f-735d-4ea8-bd55-ea6a50962616 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.153888 Dec 15 11:31:41.694765 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 125/247] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:41 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:42.550516 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e173ea2e-0d63-4bde-9183-2a66568f50fd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:42.551547 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e173ea2e-0d63-4bde-9183-2a66568f50fd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:42.558914 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e173ea2e-0d63-4bde-9183-2a66568f50fd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:42.559478 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e173ea2e-0d63-4bde-9183-2a66568f50fd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:42.560110 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e173ea2e-0d63-4bde-9183-2a66568f50fd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:42.560541 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e173ea2e-0d63-4bde-9183-2a66568f50fd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:42.568100 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b5e4d4fc-9c79-4718-bc0c-5cd24305be30 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:42.569080 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b5e4d4fc-9c79-4718-bc0c-5cd24305be30 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:42.576298 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5e4d4fc-9c79-4718-bc0c-5cd24305be30 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:42.576736 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5e4d4fc-9c79-4718-bc0c-5cd24305be30 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:42.577529 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5e4d4fc-9c79-4718-bc0c-5cd24305be30 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:42.577954 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5e4d4fc-9c79-4718-bc0c-5cd24305be30 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:42.668105 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b5e4d4fc-9c79-4718-bc0c-5cd24305be30 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 34496 microversion: 2.1 time: 0.101665 Dec 15 11:31:42.668105 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 126/248] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:42 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 34496 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:31:42.712997 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a285e8b0-27dc-40aa-a427-21902d34f30e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:42.715244 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a285e8b0-27dc-40aa-a427-21902d34f30e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:42.722341 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a285e8b0-27dc-40aa-a427-21902d34f30e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:42.722941 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a285e8b0-27dc-40aa-a427-21902d34f30e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:42.723718 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a285e8b0-27dc-40aa-a427-21902d34f30e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:42.724189 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a285e8b0-27dc-40aa-a427-21902d34f30e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:42.770950 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e173ea2e-0d63-4bde-9183-2a66568f50fd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 36717 microversion: 2.20 time: 0.224078 Dec 15 11:31:42.771974 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 123/249] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:42 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 36717 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:31:42.864897 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a285e8b0-27dc-40aa-a427-21902d34f30e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:42.872447 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a285e8b0-27dc-40aa-a427-21902d34f30e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.163826 Dec 15 11:31:42.873031 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 127/250] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:42 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:31:43.679518 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f3d91492-63a5-419f-94eb-5ac5cc714ae8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:43.680532 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f3d91492-63a5-419f-94eb-5ac5cc714ae8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:43.687382 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f3d91492-63a5-419f-94eb-5ac5cc714ae8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:43.687832 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f3d91492-63a5-419f-94eb-5ac5cc714ae8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:43.688624 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f3d91492-63a5-419f-94eb-5ac5cc714ae8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:43.689179 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f3d91492-63a5-419f-94eb-5ac5cc714ae8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:43.782808 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6f78e50a-097b-4543-8999-aa2bd39c0b84 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:43.783710 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6f78e50a-097b-4543-8999-aa2bd39c0b84 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:43.790086 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6f78e50a-097b-4543-8999-aa2bd39c0b84 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:43.790426 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6f78e50a-097b-4543-8999-aa2bd39c0b84 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:43.791233 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6f78e50a-097b-4543-8999-aa2bd39c0b84 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:43.792375 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6f78e50a-097b-4543-8999-aa2bd39c0b84 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:46.148397 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f3d91492-63a5-419f-94eb-5ac5cc714ae8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 37179 microversion: 2.1 time: 2.472681 Dec 15 11:31:46.149035 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 124/251] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:43 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 37179 bytes in 2474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:46.153820 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6f7c3666-7e49-49a5-aac9-f41639938db5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:46.154503 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6f7c3666-7e49-49a5-aac9-f41639938db5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:46.161663 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f7c3666-7e49-49a5-aac9-f41639938db5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:46.162104 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f7c3666-7e49-49a5-aac9-f41639938db5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:46.162897 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f7c3666-7e49-49a5-aac9-f41639938db5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:46.163334 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f7c3666-7e49-49a5-aac9-f41639938db5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:46.171394 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6f78e50a-097b-4543-8999-aa2bd39c0b84 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 38214 microversion: 2.20 time: 2.392100 Dec 15 11:31:46.172904 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 128/252] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:43 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 38214 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:31:46.293401 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6f7c3666-7e49-49a5-aac9-f41639938db5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:46.301104 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6f7c3666-7e49-49a5-aac9-f41639938db5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.150996 Dec 15 11:31:46.301676 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 125/253] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:46 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:47.161158 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-40735692-a060-43e7-a36e-21e81aaa2db2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:47.162167 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-40735692-a060-43e7-a36e-21e81aaa2db2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:47.169186 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40735692-a060-43e7-a36e-21e81aaa2db2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:47.169623 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40735692-a060-43e7-a36e-21e81aaa2db2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:47.170558 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40735692-a060-43e7-a36e-21e81aaa2db2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:47.171098 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40735692-a060-43e7-a36e-21e81aaa2db2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:47.183797 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-86a69997-19c5-42a1-bf4b-426cc865750a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:47.184830 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-86a69997-19c5-42a1-bf4b-426cc865750a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:47.194246 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-86a69997-19c5-42a1-bf4b-426cc865750a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:47.194675 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-86a69997-19c5-42a1-bf4b-426cc865750a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:47.195651 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-86a69997-19c5-42a1-bf4b-426cc865750a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:47.196087 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-86a69997-19c5-42a1-bf4b-426cc865750a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:47.268434 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-40735692-a060-43e7-a36e-21e81aaa2db2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 38080 microversion: 2.1 time: 0.111361 Dec 15 11:31:47.271141 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 129/254] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:47 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 38080 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:47.298537 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-86a69997-19c5-42a1-bf4b-426cc865750a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 38216 microversion: 2.20 time: 0.118532 Dec 15 11:31:47.299319 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 126/255] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:47 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 38216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:31:47.319119 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7b42b1ec-4732-4e69-8ea0-d964787ba24c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:47.319819 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7b42b1ec-4732-4e69-8ea0-d964787ba24c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:47.327988 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7b42b1ec-4732-4e69-8ea0-d964787ba24c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:47.328437 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7b42b1ec-4732-4e69-8ea0-d964787ba24c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:47.329215 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7b42b1ec-4732-4e69-8ea0-d964787ba24c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:47.329649 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7b42b1ec-4732-4e69-8ea0-d964787ba24c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:47.602116 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7b42b1ec-4732-4e69-8ea0-d964787ba24c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:47.610513 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7b42b1ec-4732-4e69-8ea0-d964787ba24c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.295340 Dec 15 11:31:47.611115 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 130/256] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:47 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:31:48.281025 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-62c8fa68-7cf8-405f-9f9a-2bda9e76184d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:48.281957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-62c8fa68-7cf8-405f-9f9a-2bda9e76184d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:48.288805 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62c8fa68-7cf8-405f-9f9a-2bda9e76184d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:48.289252 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62c8fa68-7cf8-405f-9f9a-2bda9e76184d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:48.290025 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62c8fa68-7cf8-405f-9f9a-2bda9e76184d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:48.290460 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62c8fa68-7cf8-405f-9f9a-2bda9e76184d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:48.311018 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ba9fb3c0-cb20-4672-a868-f66f123ba1f7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:48.311995 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ba9fb3c0-cb20-4672-a868-f66f123ba1f7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:48.318879 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ba9fb3c0-cb20-4672-a868-f66f123ba1f7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:48.319328 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ba9fb3c0-cb20-4672-a868-f66f123ba1f7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:48.320108 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ba9fb3c0-cb20-4672-a868-f66f123ba1f7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:48.320542 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ba9fb3c0-cb20-4672-a868-f66f123ba1f7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:50.318166 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ba9fb3c0-cb20-4672-a868-f66f123ba1f7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 200 len: 38353 microversion: 2.20 time: 2.010534 Dec 15 11:31:50.318859 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 131/257] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:48 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 38353 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:31:50.324507 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-05d5050c-7144-483f-bb5c-304eb8a6b004 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:50.325204 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-05d5050c-7144-483f-bb5c-304eb8a6b004 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:50.331928 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05d5050c-7144-483f-bb5c-304eb8a6b004 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:50.332373 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05d5050c-7144-483f-bb5c-304eb8a6b004 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:50.333133 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-62c8fa68-7cf8-405f-9f9a-2bda9e76184d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 38153 microversion: 2.1 time: 2.056556 Dec 15 11:31:50.333572 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05d5050c-7144-483f-bb5c-304eb8a6b004 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:50.333572 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05d5050c-7144-483f-bb5c-304eb8a6b004 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:50.337469 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 127/258] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:48 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 38153 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:50.340125 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-be223268-fbae-4862-b550-5d9310e3816f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:50.340723 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-be223268-fbae-4862-b550-5d9310e3816f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:50.349705 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-be223268-fbae-4862-b550-5d9310e3816f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:50.350158 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-be223268-fbae-4862-b550-5d9310e3816f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:50.350966 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-be223268-fbae-4862-b550-5d9310e3816f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:50.351412 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-be223268-fbae-4862-b550-5d9310e3816f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:50.375782 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-be223268-fbae-4862-b550-5d9310e3816f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/ips" status: 200 len: 150 microversion: 2.20 time: 0.040509 Dec 15 11:31:50.376376 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 128/259] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Dec 15 11:31:50 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:50.471259 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-05d5050c-7144-483f-bb5c-304eb8a6b004 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:50.478387 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-05d5050c-7144-483f-bb5c-304eb8a6b004 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.158335 Dec 15 11:31:50.479020 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 132/260] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:50 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:51.345510 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5c24164c-7562-435e-8617-865619f79ae4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:51.346459 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5c24164c-7562-435e-8617-865619f79ae4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:51.352903 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5c24164c-7562-435e-8617-865619f79ae4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:51.353411 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5c24164c-7562-435e-8617-865619f79ae4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:51.354248 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5c24164c-7562-435e-8617-865619f79ae4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:51.354795 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5c24164c-7562-435e-8617-865619f79ae4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:51.438608 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5c24164c-7562-435e-8617-865619f79ae4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 38153 microversion: 2.1 time: 0.096524 Dec 15 11:31:51.442914 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 129/261] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:51 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 38153 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:51.495995 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3167e26f-e1d2-4aac-9fdd-42743b1d070c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:51.496608 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3167e26f-e1d2-4aac-9fdd-42743b1d070c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:51.505225 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3167e26f-e1d2-4aac-9fdd-42743b1d070c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:51.505454 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3167e26f-e1d2-4aac-9fdd-42743b1d070c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:51.516295 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3167e26f-e1d2-4aac-9fdd-42743b1d070c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:51.516740 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3167e26f-e1d2-4aac-9fdd-42743b1d070c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:51.673384 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3167e26f-e1d2-4aac-9fdd-42743b1d070c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:51.681505 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3167e26f-e1d2-4aac-9fdd-42743b1d070c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.189275 Dec 15 11:31:51.682301 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 133/262] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:51 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:52.451517 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-004af19b-3d57-4e7e-a7b1-430219e05f07 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:52.452626 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-004af19b-3d57-4e7e-a7b1-430219e05f07 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:52.459483 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-004af19b-3d57-4e7e-a7b1-430219e05f07 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.459926 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-004af19b-3d57-4e7e-a7b1-430219e05f07 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.460697 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-004af19b-3d57-4e7e-a7b1-430219e05f07 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.461157 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-004af19b-3d57-4e7e-a7b1-430219e05f07 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.558065 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-004af19b-3d57-4e7e-a7b1-430219e05f07 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 200 len: 38280 microversion: 2.1 time: 0.110636 Dec 15 11:31:52.558764 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 130/263] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:52 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 38280 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:31:52.568546 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4636681a-7530-4e8f-bd00-21d625c51d45 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:52.569026 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4636681a-7530-4e8f-bd00-21d625c51d45 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:52.576322 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4636681a-7530-4e8f-bd00-21d625c51d45 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.576925 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4636681a-7530-4e8f-bd00-21d625c51d45 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.578244 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4636681a-7530-4e8f-bd00-21d625c51d45 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.578716 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4636681a-7530-4e8f-bd00-21d625c51d45 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.615364 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4636681a-7530-4e8f-bd00-21d625c51d45 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/ips" status: 200 len: 145 microversion: 2.1 time: 0.050362 Dec 15 11:31:52.615926 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 134/264] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 11:31:52 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/ips => generated 145 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:31:52.700678 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a91b7088-67c9-4b54-9bea-d99fef6470b3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:52.701325 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a91b7088-67c9-4b54-9bea-d99fef6470b3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:52.708677 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a91b7088-67c9-4b54-9bea-d99fef6470b3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.709128 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a91b7088-67c9-4b54-9bea-d99fef6470b3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.709974 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a91b7088-67c9-4b54-9bea-d99fef6470b3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.710409 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a91b7088-67c9-4b54-9bea-d99fef6470b3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.851071 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a91b7088-67c9-4b54-9bea-d99fef6470b3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:52.859456 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a91b7088-67c9-4b54-9bea-d99fef6470b3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1499 microversion: 2.1 time: 0.163169 Dec 15 11:31:52.860041 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 131/265] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:52 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1499 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:52.880836 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9167b1d8-e381-4b88-abd0-b5d1843c36f0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21e24975-07e8-4a4e-a96c-5d43d1b5f0f7"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:52.882150 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9167b1d8-e381-4b88-abd0-b5d1843c36f0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:52.889672 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9167b1d8-e381-4b88-abd0-b5d1843c36f0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.890118 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9167b1d8-e381-4b88-abd0-b5d1843c36f0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.891042 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9167b1d8-e381-4b88-abd0-b5d1843c36f0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.891524 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9167b1d8-e381-4b88-abd0-b5d1843c36f0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.923959 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-9167b1d8-e381-4b88-abd0-b5d1843c36f0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] HTTP exception thrown: Cannot 'attach_volume' instance 9c2f09d7-6122-484a-b99c-33d451ae87a9 while it is in vm_state rescued Dec 15 11:31:52.924856 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9167b1d8-e381-4b88-abd0-b5d1843c36f0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Returning 409 to user: Cannot 'attach_volume' instance 9c2f09d7-6122-484a-b99c-33d451ae87a9 while it is in vm_state rescued {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:31:52.926125 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9167b1d8-e381-4b88-abd0-b5d1843c36f0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049783 Dec 15 11:31:52.927055 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 135/266] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:31:52 2021] POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 11:31:52.936105 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b18d7087-03d0-41f0-98e7-4500830e83ce tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:52.936644 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b18d7087-03d0-41f0-98e7-4500830e83ce tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:52.942445 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b18d7087-03d0-41f0-98e7-4500830e83ce tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.942931 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b18d7087-03d0-41f0-98e7-4500830e83ce tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.943715 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b18d7087-03d0-41f0-98e7-4500830e83ce tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.944148 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b18d7087-03d0-41f0-98e7-4500830e83ce tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.966554 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e2e90e08-911d-4b11-81a1-484689effa11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:52.967038 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e2e90e08-911d-4b11-81a1-484689effa11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:52.972864 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e2e90e08-911d-4b11-81a1-484689effa11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.973305 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e2e90e08-911d-4b11-81a1-484689effa11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.974159 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e2e90e08-911d-4b11-81a1-484689effa11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:52.974622 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e2e90e08-911d-4b11-81a1-484689effa11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:52.999995 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-e2e90e08-911d-4b11-81a1-484689effa11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lazy-loading 'flavor' on Instance uuid 0866db17-45ec-4550-b834-8880e974be1d {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:31:53.010034 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b18d7087-03d0-41f0-98e7-4500830e83ce tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/action" status: 202 len: 0 microversion: 2.1 time: 0.077918 Dec 15 11:31:53.011433 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 132/267] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:31:52 2021] POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:31:53.019924 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a2a3d625-820d-4420-aa67-6937d717e642 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:53.020683 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a2a3d625-820d-4420-aa67-6937d717e642 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:53.027655 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a2a3d625-820d-4420-aa67-6937d717e642 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:53.028110 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a2a3d625-820d-4420-aa67-6937d717e642 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:53.028948 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a2a3d625-820d-4420-aa67-6937d717e642 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:53.029387 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a2a3d625-820d-4420-aa67-6937d717e642 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:53.295391 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a2a3d625-820d-4420-aa67-6937d717e642 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:53.309039 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a2a3d625-820d-4420-aa67-6937d717e642 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1507 microversion: 2.1 time: 0.292841 Dec 15 11:31:53.310171 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 133/268] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:53 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:31:53.379591 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e2e90e08-911d-4b11-81a1-484689effa11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 202 len: 0 microversion: 2.20 time: 0.417402 Dec 15 11:31:53.382599 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 136/269] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:31:52 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 15 11:31:53.389135 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-550233cf-c040-498a-8e25-8211448eb766 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:53.389828 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-550233cf-c040-498a-8e25-8211448eb766 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:53.399722 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-550233cf-c040-498a-8e25-8211448eb766 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:53.401410 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-550233cf-c040-498a-8e25-8211448eb766 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:53.402675 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-550233cf-c040-498a-8e25-8211448eb766 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:53.403263 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-550233cf-c040-498a-8e25-8211448eb766 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:53.644787 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-550233cf-c040-498a-8e25-8211448eb766 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:53.655236 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-550233cf-c040-498a-8e25-8211448eb766 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:53.656758 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-550233cf-c040-498a-8e25-8211448eb766 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:53.657942 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-550233cf-c040-498a-8e25-8211448eb766 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.273476 Dec 15 11:31:53.658795 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 134/270] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:31:53 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:31:54.328922 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-831cceb8-fa07-4589-b588-bcb03963c4fe tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:54.330180 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-831cceb8-fa07-4589-b588-bcb03963c4fe tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:54.336991 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-831cceb8-fa07-4589-b588-bcb03963c4fe tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:54.339335 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-831cceb8-fa07-4589-b588-bcb03963c4fe tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:54.340500 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-831cceb8-fa07-4589-b588-bcb03963c4fe tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:54.341223 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-831cceb8-fa07-4589-b588-bcb03963c4fe tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:54.499401 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-831cceb8-fa07-4589-b588-bcb03963c4fe tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:54.509305 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-831cceb8-fa07-4589-b588-bcb03963c4fe tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1507 microversion: 2.1 time: 0.184671 Dec 15 11:31:54.509868 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 137/271] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:54 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:54.676905 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-968bf84d-d10d-4ea9-a228-fa63b315b22b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:54.677556 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-968bf84d-d10d-4ea9-a228-fa63b315b22b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:54.684849 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-968bf84d-d10d-4ea9-a228-fa63b315b22b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:54.685297 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-968bf84d-d10d-4ea9-a228-fa63b315b22b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:54.686075 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-968bf84d-d10d-4ea9-a228-fa63b315b22b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:54.686681 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-968bf84d-d10d-4ea9-a228-fa63b315b22b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:54.822236 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-968bf84d-d10d-4ea9-a228-fa63b315b22b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:54.830906 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-968bf84d-d10d-4ea9-a228-fa63b315b22b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:54.832451 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-968bf84d-d10d-4ea9-a228-fa63b315b22b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:54.833626 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-968bf84d-d10d-4ea9-a228-fa63b315b22b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.160445 Dec 15 11:31:54.834184 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 135/272] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:31:54 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:31:55.528382 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1cf626a8-8024-45da-8a7c-7a04f5f7e3db tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:55.528985 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1cf626a8-8024-45da-8a7c-7a04f5f7e3db tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:55.535445 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1cf626a8-8024-45da-8a7c-7a04f5f7e3db tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:55.536162 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1cf626a8-8024-45da-8a7c-7a04f5f7e3db tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:55.537160 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1cf626a8-8024-45da-8a7c-7a04f5f7e3db tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:55.537801 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1cf626a8-8024-45da-8a7c-7a04f5f7e3db tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:55.687454 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b050176d-4018-4ec7-ab08-322ad60220b2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77e130bc-1e57-4d5a-8cd4-644fe38e943f"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:55.689511 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b050176d-4018-4ec7-ab08-322ad60220b2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:55.698419 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b050176d-4018-4ec7-ab08-322ad60220b2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:55.699827 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b050176d-4018-4ec7-ab08-322ad60220b2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:55.700867 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b050176d-4018-4ec7-ab08-322ad60220b2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:55.701527 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b050176d-4018-4ec7-ab08-322ad60220b2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:55.710343 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1cf626a8-8024-45da-8a7c-7a04f5f7e3db tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:55.720408 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1cf626a8-8024-45da-8a7c-7a04f5f7e3db tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1507 microversion: 2.1 time: 0.196128 Dec 15 11:31:55.720904 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 138/273] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:55 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:55.853019 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-83bbe52a-153c-42b4-bf2d-42d9827621e0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:55.855306 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-83bbe52a-153c-42b4-bf2d-42d9827621e0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:55.868700 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83bbe52a-153c-42b4-bf2d-42d9827621e0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:55.870329 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83bbe52a-153c-42b4-bf2d-42d9827621e0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:55.871399 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83bbe52a-153c-42b4-bf2d-42d9827621e0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:55.872631 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83bbe52a-153c-42b4-bf2d-42d9827621e0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:56.135897 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-83bbe52a-153c-42b4-bf2d-42d9827621e0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:56.154457 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-83bbe52a-153c-42b4-bf2d-42d9827621e0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:56.156626 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-83bbe52a-153c-42b4-bf2d-42d9827621e0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:56.158859 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-83bbe52a-153c-42b4-bf2d-42d9827621e0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.309835 Dec 15 11:31:56.159611 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 139/274] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:31:55 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:31:56.169499 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b050176d-4018-4ec7-ab08-322ad60220b2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485444 Dec 15 11:31:56.171452 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 136/275] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:31:55 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:31:56.736908 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-245c5655-2640-4444-b3ed-b7b3658815ed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:56.738026 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-245c5655-2640-4444-b3ed-b7b3658815ed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:56.745566 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-245c5655-2640-4444-b3ed-b7b3658815ed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:56.746479 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-245c5655-2640-4444-b3ed-b7b3658815ed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:56.747946 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-245c5655-2640-4444-b3ed-b7b3658815ed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:56.748395 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-245c5655-2640-4444-b3ed-b7b3658815ed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:56.919100 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-245c5655-2640-4444-b3ed-b7b3658815ed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:56.927117 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-245c5655-2640-4444-b3ed-b7b3658815ed tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1513 microversion: 2.1 time: 0.193676 Dec 15 11:31:56.927878 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 140/276] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:56 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:57.178824 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0d1c185e-046e-4c8b-aefe-da4a783657eb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:57.179674 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-0d1c185e-046e-4c8b-aefe-da4a783657eb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:57.190761 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0d1c185e-046e-4c8b-aefe-da4a783657eb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:57.191749 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0d1c185e-046e-4c8b-aefe-da4a783657eb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:57.192791 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0d1c185e-046e-4c8b-aefe-da4a783657eb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:57.198406 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0d1c185e-046e-4c8b-aefe-da4a783657eb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:57.576414 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-0d1c185e-046e-4c8b-aefe-da4a783657eb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:57.585081 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-0d1c185e-046e-4c8b-aefe-da4a783657eb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:57.586593 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-0d1c185e-046e-4c8b-aefe-da4a783657eb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:57.596355 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0d1c185e-046e-4c8b-aefe-da4a783657eb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.422083 Dec 15 11:31:57.607641 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 137/277] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:31:57 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:31:58.400998 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6ead4566-91f6-406f-af42-3b73b84e1ed7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:58.404093 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6ead4566-91f6-406f-af42-3b73b84e1ed7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:58.414774 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ead4566-91f6-406f-af42-3b73b84e1ed7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:58.415506 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ead4566-91f6-406f-af42-3b73b84e1ed7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:58.416377 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ead4566-91f6-406f-af42-3b73b84e1ed7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:58.417234 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ead4566-91f6-406f-af42-3b73b84e1ed7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:58.595036 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6ead4566-91f6-406f-af42-3b73b84e1ed7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:58.602655 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6ead4566-91f6-406f-af42-3b73b84e1ed7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1513 microversion: 2.1 time: 0.205863 Dec 15 11:31:58.603634 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 141/278] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:31:58 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:31:58.620480 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b93cf2d7-fb25-4d10-83f1-379dcd62151a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4de94aef-8522-4944-942d-d5ac0735647f"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:31:58.621757 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b93cf2d7-fb25-4d10-83f1-379dcd62151a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:58.623724 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-41b978b1-06fb-4efc-b33e-92a44f134258 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:58.624920 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-41b978b1-06fb-4efc-b33e-92a44f134258 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:58.627954 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b93cf2d7-fb25-4d10-83f1-379dcd62151a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:58.628396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b93cf2d7-fb25-4d10-83f1-379dcd62151a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:58.629343 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b93cf2d7-fb25-4d10-83f1-379dcd62151a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:58.629947 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b93cf2d7-fb25-4d10-83f1-379dcd62151a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:58.632642 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-41b978b1-06fb-4efc-b33e-92a44f134258 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:58.633144 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-41b978b1-06fb-4efc-b33e-92a44f134258 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:58.633926 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-41b978b1-06fb-4efc-b33e-92a44f134258 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:58.634380 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-41b978b1-06fb-4efc-b33e-92a44f134258 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:58.801616 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-41b978b1-06fb-4efc-b33e-92a44f134258 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:58.812691 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-41b978b1-06fb-4efc-b33e-92a44f134258 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:58.814730 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-41b978b1-06fb-4efc-b33e-92a44f134258 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:58.816110 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-41b978b1-06fb-4efc-b33e-92a44f134258 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.200787 Dec 15 11:31:58.817235 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 138/279] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:31:58 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:31:58.940037 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b93cf2d7-fb25-4d10-83f1-379dcd62151a tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323887 Dec 15 11:31:58.941141 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 142/280] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:31:58 2021] POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:31:59.834878 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-00044cb1-a28f-494b-a0be-1955ff3158cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:31:59.835489 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-00044cb1-a28f-494b-a0be-1955ff3158cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:31:59.842191 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-00044cb1-a28f-494b-a0be-1955ff3158cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:59.842699 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-00044cb1-a28f-494b-a0be-1955ff3158cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:59.843481 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-00044cb1-a28f-494b-a0be-1955ff3158cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:31:59.843910 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-00044cb1-a28f-494b-a0be-1955ff3158cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:31:59.974413 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-00044cb1-a28f-494b-a0be-1955ff3158cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:59.982525 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-00044cb1-a28f-494b-a0be-1955ff3158cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:59.984029 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-00044cb1-a28f-494b-a0be-1955ff3158cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:31:59.985172 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-00044cb1-a28f-494b-a0be-1955ff3158cc tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.153995 Dec 15 11:31:59.985736 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 139/281] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:31:59 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:01.004622 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-aa47d268-7830-43b9-9ef1-e37d822ca6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:01.005956 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-aa47d268-7830-43b9-9ef1-e37d822ca6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:01.012749 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa47d268-7830-43b9-9ef1-e37d822ca6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:01.013406 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa47d268-7830-43b9-9ef1-e37d822ca6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:01.014185 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa47d268-7830-43b9-9ef1-e37d822ca6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:01.014640 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa47d268-7830-43b9-9ef1-e37d822ca6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:01.166407 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-aa47d268-7830-43b9-9ef1-e37d822ca6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:01.177603 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-aa47d268-7830-43b9-9ef1-e37d822ca6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:01.179442 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-aa47d268-7830-43b9-9ef1-e37d822ca6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:01.181348 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-aa47d268-7830-43b9-9ef1-e37d822ca6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.181228 Dec 15 11:32:01.183354 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 143/282] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:00 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:02.201404 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4817f73d-99cd-4b97-af34-1a0d2ad2bb8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:02.202009 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4817f73d-99cd-4b97-af34-1a0d2ad2bb8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:02.218808 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4817f73d-99cd-4b97-af34-1a0d2ad2bb8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:02.219659 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4817f73d-99cd-4b97-af34-1a0d2ad2bb8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:02.220456 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4817f73d-99cd-4b97-af34-1a0d2ad2bb8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:02.220885 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4817f73d-99cd-4b97-af34-1a0d2ad2bb8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:02.352196 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4817f73d-99cd-4b97-af34-1a0d2ad2bb8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:02.360663 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4817f73d-99cd-4b97-af34-1a0d2ad2bb8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:02.362145 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4817f73d-99cd-4b97-af34-1a0d2ad2bb8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:02.363318 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4817f73d-99cd-4b97-af34-1a0d2ad2bb8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.166287 Dec 15 11:32:02.363868 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 140/283] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:02 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:03.381009 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-db5fadaf-0d04-4f9f-8d4d-b4c433d1efc5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:03.381614 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-db5fadaf-0d04-4f9f-8d4d-b4c433d1efc5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:03.387988 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db5fadaf-0d04-4f9f-8d4d-b4c433d1efc5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:03.388432 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db5fadaf-0d04-4f9f-8d4d-b4c433d1efc5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:03.389201 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db5fadaf-0d04-4f9f-8d4d-b4c433d1efc5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:03.389638 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db5fadaf-0d04-4f9f-8d4d-b4c433d1efc5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:03.523947 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-db5fadaf-0d04-4f9f-8d4d-b4c433d1efc5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:03.532538 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-db5fadaf-0d04-4f9f-8d4d-b4c433d1efc5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:03.534029 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-db5fadaf-0d04-4f9f-8d4d-b4c433d1efc5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:03.535223 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-db5fadaf-0d04-4f9f-8d4d-b4c433d1efc5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.157955 Dec 15 11:32:03.535780 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 144/284] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:03 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:03.715773 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-11d3adc8-413f-4eaf-a471-ab1c398ccbe2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:32:03.722308 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11d3adc8-413f-4eaf-a471-ab1c398ccbe2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:03.722707 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11d3adc8-413f-4eaf-a471-ab1c398ccbe2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:03.792010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-11d3adc8-413f-4eaf-a471-ab1c398ccbe2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Going to try to stop instance {{(pid=116082) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 11:32:03.841883 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-11d3adc8-413f-4eaf-a471-ab1c398ccbe2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 202 len: 0 microversion: 2.1 time: 0.130400 Dec 15 11:32:03.843072 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 141/285] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:32:03 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:32:03.856894 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e0f5c97f-dc65-4ab9-83d5-3a652ee14e32 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:03.857781 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e0f5c97f-dc65-4ab9-83d5-3a652ee14e32 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:03.864956 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e0f5c97f-dc65-4ab9-83d5-3a652ee14e32 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:03.865524 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e0f5c97f-dc65-4ab9-83d5-3a652ee14e32 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:03.866377 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e0f5c97f-dc65-4ab9-83d5-3a652ee14e32 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:03.866911 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e0f5c97f-dc65-4ab9-83d5-3a652ee14e32 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:04.040630 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e0f5c97f-dc65-4ab9-83d5-3a652ee14e32 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:04.049388 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e0f5c97f-dc65-4ab9-83d5-3a652ee14e32 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.202190 Dec 15 11:32:04.049953 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 145/286] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:03 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:04.553617 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e922fe11-c483-4d82-8081-f66d2a3c2be3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:04.554246 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e922fe11-c483-4d82-8081-f66d2a3c2be3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:04.560248 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e922fe11-c483-4d82-8081-f66d2a3c2be3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:04.560794 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e922fe11-c483-4d82-8081-f66d2a3c2be3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:04.561582 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e922fe11-c483-4d82-8081-f66d2a3c2be3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:04.562136 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e922fe11-c483-4d82-8081-f66d2a3c2be3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:04.706420 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e922fe11-c483-4d82-8081-f66d2a3c2be3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:04.714807 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e922fe11-c483-4d82-8081-f66d2a3c2be3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:04.716390 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e922fe11-c483-4d82-8081-f66d2a3c2be3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:04.717585 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e922fe11-c483-4d82-8081-f66d2a3c2be3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.168102 Dec 15 11:32:04.718949 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 142/287] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:04 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:05.067339 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bc1d79cc-36ac-46d6-af87-1f6360ab562a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:05.067943 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bc1d79cc-36ac-46d6-af87-1f6360ab562a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:05.074085 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc1d79cc-36ac-46d6-af87-1f6360ab562a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:05.074524 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc1d79cc-36ac-46d6-af87-1f6360ab562a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:05.075313 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc1d79cc-36ac-46d6-af87-1f6360ab562a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:05.075737 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc1d79cc-36ac-46d6-af87-1f6360ab562a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:05.216920 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-bc1d79cc-36ac-46d6-af87-1f6360ab562a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:05.227162 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bc1d79cc-36ac-46d6-af87-1f6360ab562a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.163348 Dec 15 11:32:05.227749 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 146/288] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:05 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:05.740756 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-764346d5-0397-444f-9b59-5576ed3d315d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:05.741392 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-764346d5-0397-444f-9b59-5576ed3d315d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:05.748872 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-764346d5-0397-444f-9b59-5576ed3d315d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:05.749563 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-764346d5-0397-444f-9b59-5576ed3d315d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:05.750416 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-764346d5-0397-444f-9b59-5576ed3d315d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:05.750879 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-764346d5-0397-444f-9b59-5576ed3d315d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:05.918030 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-764346d5-0397-444f-9b59-5576ed3d315d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:05.929811 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-764346d5-0397-444f-9b59-5576ed3d315d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:05.931687 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-764346d5-0397-444f-9b59-5576ed3d315d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:05.933124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-764346d5-0397-444f-9b59-5576ed3d315d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.195941 Dec 15 11:32:05.933714 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 143/289] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:05 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:06.245081 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1a89ad94-598f-440f-9d81-b5b94e9b599c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:06.245822 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1a89ad94-598f-440f-9d81-b5b94e9b599c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:06.253128 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a89ad94-598f-440f-9d81-b5b94e9b599c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:06.253577 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a89ad94-598f-440f-9d81-b5b94e9b599c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:06.254370 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a89ad94-598f-440f-9d81-b5b94e9b599c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:06.254838 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a89ad94-598f-440f-9d81-b5b94e9b599c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:06.409757 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1a89ad94-598f-440f-9d81-b5b94e9b599c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:06.419999 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1a89ad94-598f-440f-9d81-b5b94e9b599c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.178230 Dec 15 11:32:06.420790 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 147/290] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:06 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:06.952995 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d1dbfb97-b12c-40d4-9ba6-777850caf920 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:06.953485 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d1dbfb97-b12c-40d4-9ba6-777850caf920 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:06.959877 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d1dbfb97-b12c-40d4-9ba6-777850caf920 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:06.960324 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d1dbfb97-b12c-40d4-9ba6-777850caf920 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:06.961096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d1dbfb97-b12c-40d4-9ba6-777850caf920 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:06.961519 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d1dbfb97-b12c-40d4-9ba6-777850caf920 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:07.101355 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d1dbfb97-b12c-40d4-9ba6-777850caf920 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:07.109802 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d1dbfb97-b12c-40d4-9ba6-777850caf920 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:07.111452 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d1dbfb97-b12c-40d4-9ba6-777850caf920 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:07.113265 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d1dbfb97-b12c-40d4-9ba6-777850caf920 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.164497 Dec 15 11:32:07.113265 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 144/291] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:06 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:07.437392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6a8e7ce3-2b73-4027-aeaf-cbc4c7e66211 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:07.438086 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6a8e7ce3-2b73-4027-aeaf-cbc4c7e66211 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:07.444677 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a8e7ce3-2b73-4027-aeaf-cbc4c7e66211 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:07.445130 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a8e7ce3-2b73-4027-aeaf-cbc4c7e66211 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:07.445960 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a8e7ce3-2b73-4027-aeaf-cbc4c7e66211 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:07.446471 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a8e7ce3-2b73-4027-aeaf-cbc4c7e66211 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:07.594200 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6a8e7ce3-2b73-4027-aeaf-cbc4c7e66211 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:07.602270 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6a8e7ce3-2b73-4027-aeaf-cbc4c7e66211 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.169093 Dec 15 11:32:07.602958 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 148/292] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:07 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:08.131883 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-1869d95e-13f5-4311-b021-053cc567f61b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:08.132492 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-1869d95e-13f5-4311-b021-053cc567f61b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:08.139292 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1869d95e-13f5-4311-b021-053cc567f61b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:08.139859 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1869d95e-13f5-4311-b021-053cc567f61b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:08.140651 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1869d95e-13f5-4311-b021-053cc567f61b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:08.141090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1869d95e-13f5-4311-b021-053cc567f61b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:08.363574 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-1869d95e-13f5-4311-b021-053cc567f61b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:08.373344 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-1869d95e-13f5-4311-b021-053cc567f61b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:08.375182 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-1869d95e-13f5-4311-b021-053cc567f61b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:08.376665 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-1869d95e-13f5-4311-b021-053cc567f61b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.248572 Dec 15 11:32:08.377358 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 145/293] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:08 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:08.618972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4dde9cae-8779-49a7-9652-70d4ee0e4022 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:08.619742 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4dde9cae-8779-49a7-9652-70d4ee0e4022 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:08.626747 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4dde9cae-8779-49a7-9652-70d4ee0e4022 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:08.627238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4dde9cae-8779-49a7-9652-70d4ee0e4022 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:08.628044 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4dde9cae-8779-49a7-9652-70d4ee0e4022 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:08.628685 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4dde9cae-8779-49a7-9652-70d4ee0e4022 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:08.768030 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4dde9cae-8779-49a7-9652-70d4ee0e4022 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:08.777662 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4dde9cae-8779-49a7-9652-70d4ee0e4022 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.162115 Dec 15 11:32:08.789016 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 149/294] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:08 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:09.394339 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ea5e0e0e-96b5-4dd4-ad05-fd3137190f04 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:09.395199 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-ea5e0e0e-96b5-4dd4-ad05-fd3137190f04 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:09.401700 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ea5e0e0e-96b5-4dd4-ad05-fd3137190f04 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:09.402147 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ea5e0e0e-96b5-4dd4-ad05-fd3137190f04 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:09.402951 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ea5e0e0e-96b5-4dd4-ad05-fd3137190f04 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:09.403381 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ea5e0e0e-96b5-4dd4-ad05-fd3137190f04 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:09.548808 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ea5e0e0e-96b5-4dd4-ad05-fd3137190f04 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:09.556549 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ea5e0e0e-96b5-4dd4-ad05-fd3137190f04 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:09.558100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ea5e0e0e-96b5-4dd4-ad05-fd3137190f04 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:09.559233 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ea5e0e0e-96b5-4dd4-ad05-fd3137190f04 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.169032 Dec 15 11:32:09.559787 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 146/295] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:09 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:09.697983 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-46f12bbc-96d2-4d18-9528-568c6769e176 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:32:09.699210 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-46f12bbc-96d2-4d18-9528-568c6769e176 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:09.706865 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46f12bbc-96d2-4d18-9528-568c6769e176 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:09.707339 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46f12bbc-96d2-4d18-9528-568c6769e176 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:09.708395 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46f12bbc-96d2-4d18-9528-568c6769e176 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:09.709062 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46f12bbc-96d2-4d18-9528-568c6769e176 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:09.734233 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-46f12bbc-96d2-4d18-9528-568c6769e176 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lazy-loading 'flavor' on Instance uuid 9c2f09d7-6122-484a-b99c-33d451ae87a9 {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:32:09.795735 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-1a27d46f-a2f4-4e8b-a877-702dac262e06 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:09.796338 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-1a27d46f-a2f4-4e8b-a877-702dac262e06 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:09.802456 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a27d46f-a2f4-4e8b-a877-702dac262e06 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:09.802934 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a27d46f-a2f4-4e8b-a877-702dac262e06 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:09.803808 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a27d46f-a2f4-4e8b-a877-702dac262e06 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:09.804252 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a27d46f-a2f4-4e8b-a877-702dac262e06 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:09.861880 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-46f12bbc-96d2-4d18-9528-568c6769e176 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/action" status: 200 len: 32 microversion: 2.1 time: 0.167737 Dec 15 11:32:09.862986 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 150/296] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:32:09 2021] POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:32:09.872162 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d2f3fbe3-2c72-44a1-a368-9546eea3b0de tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:09.873632 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d2f3fbe3-2c72-44a1-a368-9546eea3b0de tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:09.879741 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2f3fbe3-2c72-44a1-a368-9546eea3b0de tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:09.880187 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2f3fbe3-2c72-44a1-a368-9546eea3b0de tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:09.880975 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2f3fbe3-2c72-44a1-a368-9546eea3b0de tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:09.881407 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2f3fbe3-2c72-44a1-a368-9546eea3b0de tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:09.991530 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-1a27d46f-a2f4-4e8b-a877-702dac262e06 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:10.000742 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-1a27d46f-a2f4-4e8b-a877-702dac262e06 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.209176 Dec 15 11:32:10.001313 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 147/297] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:09 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:10.034959 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d2f3fbe3-2c72-44a1-a368-9546eea3b0de tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:10.042869 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d2f3fbe3-2c72-44a1-a368-9546eea3b0de tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.174586 Dec 15 11:32:10.043420 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 151/298] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:09 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:10.578428 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-448d6625-6e0b-41e3-adb7-59016dfc2fac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:10.579085 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-448d6625-6e0b-41e3-adb7-59016dfc2fac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:10.585400 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-448d6625-6e0b-41e3-adb7-59016dfc2fac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:10.585845 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-448d6625-6e0b-41e3-adb7-59016dfc2fac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:10.586633 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-448d6625-6e0b-41e3-adb7-59016dfc2fac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:10.587329 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-448d6625-6e0b-41e3-adb7-59016dfc2fac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:10.724091 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-448d6625-6e0b-41e3-adb7-59016dfc2fac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:10.732038 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-448d6625-6e0b-41e3-adb7-59016dfc2fac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:10.733759 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-448d6625-6e0b-41e3-adb7-59016dfc2fac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:10.734967 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-448d6625-6e0b-41e3-adb7-59016dfc2fac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.161299 Dec 15 11:32:10.735596 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 148/299] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:10 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:11.018225 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-15eb304e-4538-4e13-90e5-ff5c0f054800 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:11.018791 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-15eb304e-4538-4e13-90e5-ff5c0f054800 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:11.025092 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15eb304e-4538-4e13-90e5-ff5c0f054800 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:11.025540 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15eb304e-4538-4e13-90e5-ff5c0f054800 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:11.026319 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15eb304e-4538-4e13-90e5-ff5c0f054800 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:11.026794 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15eb304e-4538-4e13-90e5-ff5c0f054800 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:11.060391 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e4f8cb04-3b7c-421a-b13a-fdc08c9ab2b7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:11.060998 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e4f8cb04-3b7c-421a-b13a-fdc08c9ab2b7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:11.066869 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e4f8cb04-3b7c-421a-b13a-fdc08c9ab2b7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:11.067330 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e4f8cb04-3b7c-421a-b13a-fdc08c9ab2b7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:11.068217 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e4f8cb04-3b7c-421a-b13a-fdc08c9ab2b7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:11.068672 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e4f8cb04-3b7c-421a-b13a-fdc08c9ab2b7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:11.165467 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-15eb304e-4538-4e13-90e5-ff5c0f054800 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:11.173385 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-15eb304e-4538-4e13-90e5-ff5c0f054800 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.158854 Dec 15 11:32:11.173968 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 152/300] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:11 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:11.209796 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e4f8cb04-3b7c-421a-b13a-fdc08c9ab2b7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:11.217990 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e4f8cb04-3b7c-421a-b13a-fdc08c9ab2b7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.161266 Dec 15 11:32:11.218551 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 149/301] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:11 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:11.753513 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0aab0e83-0015-4812-9ed7-0dce55471a41 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:11.754121 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0aab0e83-0015-4812-9ed7-0dce55471a41 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:11.760011 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aab0e83-0015-4812-9ed7-0dce55471a41 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:11.760451 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aab0e83-0015-4812-9ed7-0dce55471a41 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:11.761242 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aab0e83-0015-4812-9ed7-0dce55471a41 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:11.761649 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aab0e83-0015-4812-9ed7-0dce55471a41 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:11.893604 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0aab0e83-0015-4812-9ed7-0dce55471a41 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:11.901262 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0aab0e83-0015-4812-9ed7-0dce55471a41 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:11.902773 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0aab0e83-0015-4812-9ed7-0dce55471a41 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:11.904790 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0aab0e83-0015-4812-9ed7-0dce55471a41 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.155019 Dec 15 11:32:11.905446 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 153/302] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:11 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:12.190931 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3548394b-fcce-418f-afae-c185eea74bb6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:12.191707 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3548394b-fcce-418f-afae-c185eea74bb6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:12.197792 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3548394b-fcce-418f-afae-c185eea74bb6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:12.198228 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3548394b-fcce-418f-afae-c185eea74bb6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:12.199021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3548394b-fcce-418f-afae-c185eea74bb6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:12.199507 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3548394b-fcce-418f-afae-c185eea74bb6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:12.235635 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-76c4d18d-8a68-4aa8-8a45-2afa9187d23d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:12.236630 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-76c4d18d-8a68-4aa8-8a45-2afa9187d23d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:12.244834 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76c4d18d-8a68-4aa8-8a45-2afa9187d23d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:12.245527 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76c4d18d-8a68-4aa8-8a45-2afa9187d23d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:12.246312 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76c4d18d-8a68-4aa8-8a45-2afa9187d23d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:12.246809 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76c4d18d-8a68-4aa8-8a45-2afa9187d23d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:12.339273 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-3548394b-fcce-418f-afae-c185eea74bb6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:12.348648 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3548394b-fcce-418f-afae-c185eea74bb6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.161261 Dec 15 11:32:12.349228 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 150/303] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:12 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:12.393456 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-76c4d18d-8a68-4aa8-8a45-2afa9187d23d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:12.401592 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-76c4d18d-8a68-4aa8-8a45-2afa9187d23d tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.170015 Dec 15 11:32:12.402169 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 154/304] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:12 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:12.925226 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d2def48a-0107-4646-a8da-f47176526858 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:12.925835 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d2def48a-0107-4646-a8da-f47176526858 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:12.932048 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d2def48a-0107-4646-a8da-f47176526858 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:12.932581 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d2def48a-0107-4646-a8da-f47176526858 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:12.933300 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d2def48a-0107-4646-a8da-f47176526858 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:12.933730 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d2def48a-0107-4646-a8da-f47176526858 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:13.073436 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d2def48a-0107-4646-a8da-f47176526858 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:13.081601 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d2def48a-0107-4646-a8da-f47176526858 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:13.083132 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d2def48a-0107-4646-a8da-f47176526858 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:13.084286 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d2def48a-0107-4646-a8da-f47176526858 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.162725 Dec 15 11:32:13.084846 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 151/305] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:12 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:13.366413 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b5411082-e623-4f1b-b8ac-3da086d74aee tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:13.367036 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b5411082-e623-4f1b-b8ac-3da086d74aee tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:13.374039 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5411082-e623-4f1b-b8ac-3da086d74aee tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:13.374477 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5411082-e623-4f1b-b8ac-3da086d74aee tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:13.375262 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5411082-e623-4f1b-b8ac-3da086d74aee tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:13.375945 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5411082-e623-4f1b-b8ac-3da086d74aee tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:13.418558 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f71b4ec7-be66-47bf-a983-6daba2dd723b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:13.419209 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f71b4ec7-be66-47bf-a983-6daba2dd723b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:13.426397 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f71b4ec7-be66-47bf-a983-6daba2dd723b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:13.426878 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f71b4ec7-be66-47bf-a983-6daba2dd723b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:13.427665 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f71b4ec7-be66-47bf-a983-6daba2dd723b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:13.428482 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f71b4ec7-be66-47bf-a983-6daba2dd723b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:13.516892 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b5411082-e623-4f1b-b8ac-3da086d74aee tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:13.524942 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b5411082-e623-4f1b-b8ac-3da086d74aee tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.162113 Dec 15 11:32:13.527278 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 155/306] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:13 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:13.562332 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f71b4ec7-be66-47bf-a983-6daba2dd723b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:13.570284 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f71b4ec7-be66-47bf-a983-6daba2dd723b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.155565 Dec 15 11:32:13.570882 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 152/307] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:13 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:14.102331 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ef84c34b-bb16-4d90-a29c-46a02cded86c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:14.102966 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ef84c34b-bb16-4d90-a29c-46a02cded86c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:14.108740 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef84c34b-bb16-4d90-a29c-46a02cded86c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:14.109810 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef84c34b-bb16-4d90-a29c-46a02cded86c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:14.110740 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef84c34b-bb16-4d90-a29c-46a02cded86c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:14.111170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef84c34b-bb16-4d90-a29c-46a02cded86c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:14.255564 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ef84c34b-bb16-4d90-a29c-46a02cded86c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:14.263284 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ef84c34b-bb16-4d90-a29c-46a02cded86c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:14.264772 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ef84c34b-bb16-4d90-a29c-46a02cded86c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:14.265917 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ef84c34b-bb16-4d90-a29c-46a02cded86c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.167240 Dec 15 11:32:14.266469 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 156/308] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:14 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:32:14.543806 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6f24558e-c782-4130-811d-eb2036e60298 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:14.544409 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6f24558e-c782-4130-811d-eb2036e60298 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:14.550789 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f24558e-c782-4130-811d-eb2036e60298 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:14.551232 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f24558e-c782-4130-811d-eb2036e60298 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:14.551994 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f24558e-c782-4130-811d-eb2036e60298 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:14.552422 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6f24558e-c782-4130-811d-eb2036e60298 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:14.586777 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6636c6e2-92eb-43ec-a049-522f9efd95c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:14.587660 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6636c6e2-92eb-43ec-a049-522f9efd95c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:14.594754 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6636c6e2-92eb-43ec-a049-522f9efd95c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:14.595490 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6636c6e2-92eb-43ec-a049-522f9efd95c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:14.596504 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6636c6e2-92eb-43ec-a049-522f9efd95c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:14.596956 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6636c6e2-92eb-43ec-a049-522f9efd95c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:14.693897 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6f24558e-c782-4130-811d-eb2036e60298 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:14.702003 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6f24558e-c782-4130-811d-eb2036e60298 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.161677 Dec 15 11:32:14.702609 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 153/309] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:14 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:14.730713 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6636c6e2-92eb-43ec-a049-522f9efd95c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:14.738527 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6636c6e2-92eb-43ec-a049-522f9efd95c0 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.155226 Dec 15 11:32:14.739163 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 157/310] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:14 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:15.283525 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a22e0780-f2d1-434a-88dd-ed670d16ca00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:15.284125 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a22e0780-f2d1-434a-88dd-ed670d16ca00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:15.289999 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a22e0780-f2d1-434a-88dd-ed670d16ca00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:15.290438 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a22e0780-f2d1-434a-88dd-ed670d16ca00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:15.291269 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a22e0780-f2d1-434a-88dd-ed670d16ca00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:15.291675 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a22e0780-f2d1-434a-88dd-ed670d16ca00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:15.427991 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a22e0780-f2d1-434a-88dd-ed670d16ca00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:15.435877 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a22e0780-f2d1-434a-88dd-ed670d16ca00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:15.438073 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a22e0780-f2d1-434a-88dd-ed670d16ca00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:15.439651 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a22e0780-f2d1-434a-88dd-ed670d16ca00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.159742 Dec 15 11:32:15.440255 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 154/311] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:15 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:15.721601 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-49f84ff9-45a3-42a3-b4c0-53e42fc0e3c9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:15.722217 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-49f84ff9-45a3-42a3-b4c0-53e42fc0e3c9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:15.728961 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-49f84ff9-45a3-42a3-b4c0-53e42fc0e3c9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:15.729406 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-49f84ff9-45a3-42a3-b4c0-53e42fc0e3c9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:15.730221 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-49f84ff9-45a3-42a3-b4c0-53e42fc0e3c9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:15.730680 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-49f84ff9-45a3-42a3-b4c0-53e42fc0e3c9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:15.755439 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-74e013d9-64e0-4895-abf8-c1e0b2d869ef tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:15.756146 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-74e013d9-64e0-4895-abf8-c1e0b2d869ef tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:15.762296 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74e013d9-64e0-4895-abf8-c1e0b2d869ef tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:15.762775 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74e013d9-64e0-4895-abf8-c1e0b2d869ef tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:15.763547 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74e013d9-64e0-4895-abf8-c1e0b2d869ef tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:15.763974 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74e013d9-64e0-4895-abf8-c1e0b2d869ef tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:15.865862 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-49f84ff9-45a3-42a3-b4c0-53e42fc0e3c9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:15.873518 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-49f84ff9-45a3-42a3-b4c0-53e42fc0e3c9 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.156351 Dec 15 11:32:15.874083 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 158/312] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:15 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:15.899423 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-74e013d9-64e0-4895-abf8-c1e0b2d869ef tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:15.910442 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-74e013d9-64e0-4895-abf8-c1e0b2d869ef tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.158647 Dec 15 11:32:15.911056 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 155/313] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:15 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:16.457705 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c1ce1af7-3fd8-4c63-a5f5-f5b5f5aedccb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:16.458312 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c1ce1af7-3fd8-4c63-a5f5-f5b5f5aedccb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:16.464433 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1ce1af7-3fd8-4c63-a5f5-f5b5f5aedccb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:16.464873 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1ce1af7-3fd8-4c63-a5f5-f5b5f5aedccb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:16.465643 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1ce1af7-3fd8-4c63-a5f5-f5b5f5aedccb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:16.466075 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1ce1af7-3fd8-4c63-a5f5-f5b5f5aedccb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:16.598340 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c1ce1af7-3fd8-4c63-a5f5-f5b5f5aedccb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:16.605981 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c1ce1af7-3fd8-4c63-a5f5-f5b5f5aedccb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:16.607785 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c1ce1af7-3fd8-4c63-a5f5-f5b5f5aedccb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:16.608922 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c1ce1af7-3fd8-4c63-a5f5-f5b5f5aedccb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.154984 Dec 15 11:32:16.609749 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 159/314] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:16 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:32:16.890205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-cd0956eb-baec-42a7-a443-6f60ba650518 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:16.890988 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-cd0956eb-baec-42a7-a443-6f60ba650518 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:16.897064 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd0956eb-baec-42a7-a443-6f60ba650518 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:16.897506 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd0956eb-baec-42a7-a443-6f60ba650518 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:16.898272 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd0956eb-baec-42a7-a443-6f60ba650518 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:16.898740 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd0956eb-baec-42a7-a443-6f60ba650518 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:16.927847 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b9ba3f99-14d3-4267-b166-974053ad3cd2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:16.928442 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b9ba3f99-14d3-4267-b166-974053ad3cd2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:16.934820 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9ba3f99-14d3-4267-b166-974053ad3cd2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:16.935264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9ba3f99-14d3-4267-b166-974053ad3cd2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:16.936035 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9ba3f99-14d3-4267-b166-974053ad3cd2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:16.936486 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9ba3f99-14d3-4267-b166-974053ad3cd2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:17.037351 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-cd0956eb-baec-42a7-a443-6f60ba650518 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:17.045798 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-cd0956eb-baec-42a7-a443-6f60ba650518 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.159311 Dec 15 11:32:17.046637 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 156/315] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:16 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:17.069237 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b9ba3f99-14d3-4267-b166-974053ad3cd2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:17.076876 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b9ba3f99-14d3-4267-b166-974053ad3cd2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.152715 Dec 15 11:32:17.077425 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 160/316] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:16 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:17.628528 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-22dc7f8b-5c28-421a-83ca-05336c4c32ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:17.629197 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-22dc7f8b-5c28-421a-83ca-05336c4c32ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:17.635380 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22dc7f8b-5c28-421a-83ca-05336c4c32ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:17.635825 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22dc7f8b-5c28-421a-83ca-05336c4c32ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:17.636643 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22dc7f8b-5c28-421a-83ca-05336c4c32ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:17.637072 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22dc7f8b-5c28-421a-83ca-05336c4c32ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:17.764360 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-22dc7f8b-5c28-421a-83ca-05336c4c32ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:17.772159 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-22dc7f8b-5c28-421a-83ca-05336c4c32ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:17.773656 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-22dc7f8b-5c28-421a-83ca-05336c4c32ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:17.774838 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-22dc7f8b-5c28-421a-83ca-05336c4c32ce tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.150959 Dec 15 11:32:17.775378 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 157/317] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:17 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:18.064051 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-123ee8ba-1ba4-4e7d-82bf-001fbd170ffa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:18.064647 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-123ee8ba-1ba4-4e7d-82bf-001fbd170ffa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:18.070899 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-123ee8ba-1ba4-4e7d-82bf-001fbd170ffa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:18.071346 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-123ee8ba-1ba4-4e7d-82bf-001fbd170ffa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:18.072106 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-123ee8ba-1ba4-4e7d-82bf-001fbd170ffa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:18.072533 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-123ee8ba-1ba4-4e7d-82bf-001fbd170ffa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:18.093951 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2f5559fa-7928-4e7a-904b-cd4e6ac24d8c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:18.095209 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2f5559fa-7928-4e7a-904b-cd4e6ac24d8c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:18.101402 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f5559fa-7928-4e7a-904b-cd4e6ac24d8c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:18.101845 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f5559fa-7928-4e7a-904b-cd4e6ac24d8c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:18.102647 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f5559fa-7928-4e7a-904b-cd4e6ac24d8c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:18.103083 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f5559fa-7928-4e7a-904b-cd4e6ac24d8c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:18.206137 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-123ee8ba-1ba4-4e7d-82bf-001fbd170ffa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:18.214149 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-123ee8ba-1ba4-4e7d-82bf-001fbd170ffa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.153788 Dec 15 11:32:18.214751 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 161/318] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:18 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:18.239045 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2f5559fa-7928-4e7a-904b-cd4e6ac24d8c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:18.246791 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2f5559fa-7928-4e7a-904b-cd4e6ac24d8c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.156499 Dec 15 11:32:18.247357 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 158/319] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:18 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:18.793222 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cff32081-f6d1-412e-a215-e40ad5725c4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:18.793822 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cff32081-f6d1-412e-a215-e40ad5725c4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:18.799829 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cff32081-f6d1-412e-a215-e40ad5725c4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:18.800269 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cff32081-f6d1-412e-a215-e40ad5725c4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:18.801028 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cff32081-f6d1-412e-a215-e40ad5725c4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:18.801449 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cff32081-f6d1-412e-a215-e40ad5725c4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:18.934814 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cff32081-f6d1-412e-a215-e40ad5725c4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:18.944356 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cff32081-f6d1-412e-a215-e40ad5725c4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:18.946766 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cff32081-f6d1-412e-a215-e40ad5725c4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:18.948660 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cff32081-f6d1-412e-a215-e40ad5725c4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.159072 Dec 15 11:32:18.949498 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 162/320] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:18 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:19.231107 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-1c9a9b05-7715-4f56-a898-34a3e48c158d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:19.231735 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-1c9a9b05-7715-4f56-a898-34a3e48c158d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:19.239022 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1c9a9b05-7715-4f56-a898-34a3e48c158d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:19.239463 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1c9a9b05-7715-4f56-a898-34a3e48c158d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:19.240230 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1c9a9b05-7715-4f56-a898-34a3e48c158d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:19.240681 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1c9a9b05-7715-4f56-a898-34a3e48c158d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:19.264193 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0b9f62dc-b725-4370-8926-908479c336ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:19.264778 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0b9f62dc-b725-4370-8926-908479c336ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:19.271493 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b9f62dc-b725-4370-8926-908479c336ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:19.272292 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b9f62dc-b725-4370-8926-908479c336ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:19.281650 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b9f62dc-b725-4370-8926-908479c336ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:19.282335 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b9f62dc-b725-4370-8926-908479c336ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:19.389127 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-1c9a9b05-7715-4f56-a898-34a3e48c158d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:19.397280 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-1c9a9b05-7715-4f56-a898-34a3e48c158d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.169644 Dec 15 11:32:19.397789 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 159/321] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:19 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:19.437522 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0b9f62dc-b725-4370-8926-908479c336ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:19.445415 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0b9f62dc-b725-4370-8926-908479c336ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.184880 Dec 15 11:32:19.445972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 163/322] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:19 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:19.967524 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d1805b27-91cd-4dd1-adb1-39fa3bb4c601 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:19.968127 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d1805b27-91cd-4dd1-adb1-39fa3bb4c601 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:19.977400 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d1805b27-91cd-4dd1-adb1-39fa3bb4c601 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:19.977845 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d1805b27-91cd-4dd1-adb1-39fa3bb4c601 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:19.978661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d1805b27-91cd-4dd1-adb1-39fa3bb4c601 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:19.979099 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d1805b27-91cd-4dd1-adb1-39fa3bb4c601 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:20.107927 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d1805b27-91cd-4dd1-adb1-39fa3bb4c601 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:20.116267 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d1805b27-91cd-4dd1-adb1-39fa3bb4c601 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:20.117760 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d1805b27-91cd-4dd1-adb1-39fa3bb4c601 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:20.118932 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d1805b27-91cd-4dd1-adb1-39fa3bb4c601 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.155197 Dec 15 11:32:20.119488 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 160/323] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:19 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:20.415296 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6fa669d6-b01f-436a-b2db-fda9c7357ae1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:20.415906 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6fa669d6-b01f-436a-b2db-fda9c7357ae1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:20.422261 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6fa669d6-b01f-436a-b2db-fda9c7357ae1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:20.423379 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6fa669d6-b01f-436a-b2db-fda9c7357ae1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:20.424244 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6fa669d6-b01f-436a-b2db-fda9c7357ae1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:20.424679 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6fa669d6-b01f-436a-b2db-fda9c7357ae1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:20.462129 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e37717f7-6d17-4e6d-a980-5c62a8feb801 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:20.463035 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e37717f7-6d17-4e6d-a980-5c62a8feb801 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:20.469218 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e37717f7-6d17-4e6d-a980-5c62a8feb801 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:20.470331 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e37717f7-6d17-4e6d-a980-5c62a8feb801 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:20.471324 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e37717f7-6d17-4e6d-a980-5c62a8feb801 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:20.471750 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e37717f7-6d17-4e6d-a980-5c62a8feb801 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:20.553947 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6fa669d6-b01f-436a-b2db-fda9c7357ae1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:20.561580 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6fa669d6-b01f-436a-b2db-fda9c7357ae1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.149847 Dec 15 11:32:20.562349 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 164/324] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:20 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:20.605641 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e37717f7-6d17-4e6d-a980-5c62a8feb801 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:20.613314 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e37717f7-6d17-4e6d-a980-5c62a8feb801 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.154881 Dec 15 11:32:20.613871 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 161/325] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:20 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:21.137677 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0e669d1f-cfa2-4dac-a474-00650ce59770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:21.138286 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0e669d1f-cfa2-4dac-a474-00650ce59770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:21.144356 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e669d1f-cfa2-4dac-a474-00650ce59770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:21.144799 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e669d1f-cfa2-4dac-a474-00650ce59770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:21.145574 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e669d1f-cfa2-4dac-a474-00650ce59770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:21.146006 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e669d1f-cfa2-4dac-a474-00650ce59770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:21.280548 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0e669d1f-cfa2-4dac-a474-00650ce59770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:21.288932 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0e669d1f-cfa2-4dac-a474-00650ce59770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:21.290402 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0e669d1f-cfa2-4dac-a474-00650ce59770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:21.291561 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0e669d1f-cfa2-4dac-a474-00650ce59770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.158032 Dec 15 11:32:21.292108 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 165/326] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:21 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:21.577670 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-254ed6b4-80ad-47b5-8352-fe829bb26989 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:21.578272 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-254ed6b4-80ad-47b5-8352-fe829bb26989 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:21.585090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-254ed6b4-80ad-47b5-8352-fe829bb26989 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:21.585539 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-254ed6b4-80ad-47b5-8352-fe829bb26989 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:21.586313 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-254ed6b4-80ad-47b5-8352-fe829bb26989 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:21.586770 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-254ed6b4-80ad-47b5-8352-fe829bb26989 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:21.629061 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6475f7c4-f9f8-4656-a8ca-aef56ec30699 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:21.629666 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6475f7c4-f9f8-4656-a8ca-aef56ec30699 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:21.635973 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6475f7c4-f9f8-4656-a8ca-aef56ec30699 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:21.636418 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6475f7c4-f9f8-4656-a8ca-aef56ec30699 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:21.637192 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6475f7c4-f9f8-4656-a8ca-aef56ec30699 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:21.637626 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6475f7c4-f9f8-4656-a8ca-aef56ec30699 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:21.724785 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-254ed6b4-80ad-47b5-8352-fe829bb26989 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:21.732640 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-254ed6b4-80ad-47b5-8352-fe829bb26989 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.158645 Dec 15 11:32:21.733217 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 162/327] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:21 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:21.787073 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6475f7c4-f9f8-4656-a8ca-aef56ec30699 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:21.794822 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6475f7c4-f9f8-4656-a8ca-aef56ec30699 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.169547 Dec 15 11:32:21.795382 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 166/328] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:21 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:22.309412 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-00c1df48-1323-4a4c-9a21-dc0cc6d4c373 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:22.309915 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-00c1df48-1323-4a4c-9a21-dc0cc6d4c373 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:22.316230 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-00c1df48-1323-4a4c-9a21-dc0cc6d4c373 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:22.316674 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-00c1df48-1323-4a4c-9a21-dc0cc6d4c373 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:22.317428 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-00c1df48-1323-4a4c-9a21-dc0cc6d4c373 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:22.317854 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-00c1df48-1323-4a4c-9a21-dc0cc6d4c373 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:22.451073 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-00c1df48-1323-4a4c-9a21-dc0cc6d4c373 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:22.459769 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-00c1df48-1323-4a4c-9a21-dc0cc6d4c373 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:22.461274 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-00c1df48-1323-4a4c-9a21-dc0cc6d4c373 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:22.462701 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-00c1df48-1323-4a4c-9a21-dc0cc6d4c373 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.156774 Dec 15 11:32:22.463238 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 163/329] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:22 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:22.750082 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c6675e3e-7321-44e4-bd2d-1a2659f9a04a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:22.750714 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c6675e3e-7321-44e4-bd2d-1a2659f9a04a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:22.757574 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6675e3e-7321-44e4-bd2d-1a2659f9a04a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:22.758012 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6675e3e-7321-44e4-bd2d-1a2659f9a04a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:22.758811 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6675e3e-7321-44e4-bd2d-1a2659f9a04a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:22.759238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6675e3e-7321-44e4-bd2d-1a2659f9a04a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:22.813217 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d50616b4-b775-4112-9f23-057284e02cf7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:22.814406 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d50616b4-b775-4112-9f23-057284e02cf7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:22.820695 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d50616b4-b775-4112-9f23-057284e02cf7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:22.821150 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d50616b4-b775-4112-9f23-057284e02cf7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:22.821933 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d50616b4-b775-4112-9f23-057284e02cf7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:22.822363 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d50616b4-b775-4112-9f23-057284e02cf7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:22.893864 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c6675e3e-7321-44e4-bd2d-1a2659f9a04a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:22.901638 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c6675e3e-7321-44e4-bd2d-1a2659f9a04a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.155284 Dec 15 11:32:22.902195 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 167/330] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:22 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:22.948641 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d50616b4-b775-4112-9f23-057284e02cf7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:22.956499 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d50616b4-b775-4112-9f23-057284e02cf7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.147374 Dec 15 11:32:22.957056 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 164/331] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:22 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:23.480813 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1ad7434c-4cad-4ff8-a7f7-f97c82fdaaa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:23.481520 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1ad7434c-4cad-4ff8-a7f7-f97c82fdaaa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:23.487696 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ad7434c-4cad-4ff8-a7f7-f97c82fdaaa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:23.488163 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ad7434c-4cad-4ff8-a7f7-f97c82fdaaa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:23.488964 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ad7434c-4cad-4ff8-a7f7-f97c82fdaaa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:23.489392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ad7434c-4cad-4ff8-a7f7-f97c82fdaaa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:23.627382 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1ad7434c-4cad-4ff8-a7f7-f97c82fdaaa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:23.635030 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1ad7434c-4cad-4ff8-a7f7-f97c82fdaaa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:23.636508 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1ad7434c-4cad-4ff8-a7f7-f97c82fdaaa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:23.637635 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1ad7434c-4cad-4ff8-a7f7-f97c82fdaaa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.160511 Dec 15 11:32:23.638183 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 168/332] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:23 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:23.920227 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-199d9ffa-6dac-431c-b792-c31c2c9a1512 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:23.921579 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-199d9ffa-6dac-431c-b792-c31c2c9a1512 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:23.930625 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-199d9ffa-6dac-431c-b792-c31c2c9a1512 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:23.931290 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-199d9ffa-6dac-431c-b792-c31c2c9a1512 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:23.932467 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-199d9ffa-6dac-431c-b792-c31c2c9a1512 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:23.933115 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-199d9ffa-6dac-431c-b792-c31c2c9a1512 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:23.974893 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d1704537-e781-4f61-980e-269181ae78ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:23.975471 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d1704537-e781-4f61-980e-269181ae78ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:23.981808 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1704537-e781-4f61-980e-269181ae78ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:23.982249 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1704537-e781-4f61-980e-269181ae78ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:23.983049 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1704537-e781-4f61-980e-269181ae78ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:23.983507 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1704537-e781-4f61-980e-269181ae78ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:24.091884 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-199d9ffa-6dac-431c-b792-c31c2c9a1512 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:24.100702 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-199d9ffa-6dac-431c-b792-c31c2c9a1512 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.186351 Dec 15 11:32:24.101282 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 165/333] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:23 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:24.124077 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d1704537-e781-4f61-980e-269181ae78ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:24.133291 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d1704537-e781-4f61-980e-269181ae78ad tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.162512 Dec 15 11:32:24.133902 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 169/334] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:23 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:24.656158 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fcb015c7-013e-4290-9301-596eff8ba8d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:24.658755 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fcb015c7-013e-4290-9301-596eff8ba8d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:24.665213 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fcb015c7-013e-4290-9301-596eff8ba8d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:24.665660 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fcb015c7-013e-4290-9301-596eff8ba8d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:24.666434 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fcb015c7-013e-4290-9301-596eff8ba8d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:24.666896 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fcb015c7-013e-4290-9301-596eff8ba8d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:24.811228 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fcb015c7-013e-4290-9301-596eff8ba8d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:24.819638 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fcb015c7-013e-4290-9301-596eff8ba8d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:24.821169 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fcb015c7-013e-4290-9301-596eff8ba8d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:24.822320 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fcb015c7-013e-4290-9301-596eff8ba8d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1742 microversion: 2.20 time: 0.169846 Dec 15 11:32:24.822903 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 166/335] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:24 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:25.116791 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-509662b4-5495-400d-838b-466316c47d4b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:25.117401 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-509662b4-5495-400d-838b-466316c47d4b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:25.123753 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-509662b4-5495-400d-838b-466316c47d4b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:25.124199 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-509662b4-5495-400d-838b-466316c47d4b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:25.124974 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-509662b4-5495-400d-838b-466316c47d4b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:25.125404 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-509662b4-5495-400d-838b-466316c47d4b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:25.151976 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-298c063e-0d16-47a4-8365-60da68c4094b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:25.152583 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-298c063e-0d16-47a4-8365-60da68c4094b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:25.160333 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-298c063e-0d16-47a4-8365-60da68c4094b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:25.160599 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-298c063e-0d16-47a4-8365-60da68c4094b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:25.161385 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-298c063e-0d16-47a4-8365-60da68c4094b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:25.161919 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-298c063e-0d16-47a4-8365-60da68c4094b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:25.264472 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-509662b4-5495-400d-838b-466316c47d4b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:25.273197 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-509662b4-5495-400d-838b-466316c47d4b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.159971 Dec 15 11:32:25.278617 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 170/336] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:25 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:25.297849 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-298c063e-0d16-47a4-8365-60da68c4094b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:25.306426 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-298c063e-0d16-47a4-8365-60da68c4094b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.159125 Dec 15 11:32:25.307207 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 167/337] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:25 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:25.840845 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-45a693ff-ef3c-45fd-a3d9-99df2e120f34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:25.841591 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-45a693ff-ef3c-45fd-a3d9-99df2e120f34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:25.848765 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45a693ff-ef3c-45fd-a3d9-99df2e120f34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:25.849336 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45a693ff-ef3c-45fd-a3d9-99df2e120f34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:25.850462 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45a693ff-ef3c-45fd-a3d9-99df2e120f34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:25.851081 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45a693ff-ef3c-45fd-a3d9-99df2e120f34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:25.991275 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-45a693ff-ef3c-45fd-a3d9-99df2e120f34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:26.000066 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-45a693ff-ef3c-45fd-a3d9-99df2e120f34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:26.002874 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-45a693ff-ef3c-45fd-a3d9-99df2e120f34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:26.004036 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-45a693ff-ef3c-45fd-a3d9-99df2e120f34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1742 microversion: 2.20 time: 0.167100 Dec 15 11:32:26.004639 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 171/338] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:25 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:26.290792 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4d03a863-80e4-453f-8732-919c62bc07fb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:26.291480 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4d03a863-80e4-453f-8732-919c62bc07fb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:26.297611 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d03a863-80e4-453f-8732-919c62bc07fb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:26.298735 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d03a863-80e4-453f-8732-919c62bc07fb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:26.299535 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d03a863-80e4-453f-8732-919c62bc07fb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:26.300001 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d03a863-80e4-453f-8732-919c62bc07fb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:26.325060 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b68fae3a-5242-49ed-9ca4-f7b6c029fb20 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:26.325747 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b68fae3a-5242-49ed-9ca4-f7b6c029fb20 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:26.332465 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b68fae3a-5242-49ed-9ca4-f7b6c029fb20 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:26.333019 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b68fae3a-5242-49ed-9ca4-f7b6c029fb20 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:26.333837 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b68fae3a-5242-49ed-9ca4-f7b6c029fb20 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:26.334332 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b68fae3a-5242-49ed-9ca4-f7b6c029fb20 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:26.468850 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b68fae3a-5242-49ed-9ca4-f7b6c029fb20 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:26.478015 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b68fae3a-5242-49ed-9ca4-f7b6c029fb20 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.156569 Dec 15 11:32:26.478848 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 172/339] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:26 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:32:26.637799 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4d03a863-80e4-453f-8732-919c62bc07fb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:26.645609 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4d03a863-80e4-453f-8732-919c62bc07fb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.358460 Dec 15 11:32:26.646172 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 168/340] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:26 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:27.022102 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-41c71de7-0777-4629-96a6-9e01eb3c8009 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:27.022751 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-41c71de7-0777-4629-96a6-9e01eb3c8009 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:27.028480 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-41c71de7-0777-4629-96a6-9e01eb3c8009 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:27.028928 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-41c71de7-0777-4629-96a6-9e01eb3c8009 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:27.029704 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-41c71de7-0777-4629-96a6-9e01eb3c8009 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:27.030136 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-41c71de7-0777-4629-96a6-9e01eb3c8009 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:27.162707 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-41c71de7-0777-4629-96a6-9e01eb3c8009 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:27.171162 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-41c71de7-0777-4629-96a6-9e01eb3c8009 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:27.172656 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-41c71de7-0777-4629-96a6-9e01eb3c8009 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:27.174521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-41c71de7-0777-4629-96a6-9e01eb3c8009 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1742 microversion: 2.20 time: 0.155983 Dec 15 11:32:27.175769 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 173/341] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:27 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:27.495634 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-65c68ee4-c087-4af4-81e0-3b795cac1947 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:27.496237 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-65c68ee4-c087-4af4-81e0-3b795cac1947 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:27.502632 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65c68ee4-c087-4af4-81e0-3b795cac1947 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:27.503082 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65c68ee4-c087-4af4-81e0-3b795cac1947 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:27.503899 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65c68ee4-c087-4af4-81e0-3b795cac1947 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:27.504326 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65c68ee4-c087-4af4-81e0-3b795cac1947 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:27.628863 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-65c68ee4-c087-4af4-81e0-3b795cac1947 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:27.636802 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-65c68ee4-c087-4af4-81e0-3b795cac1947 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.144816 Dec 15 11:32:27.637377 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 169/342] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:27 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:27.662432 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-647a4fb2-639f-4a01-bc7b-1190e14a0b99 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:27.663072 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-647a4fb2-639f-4a01-bc7b-1190e14a0b99 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:27.669235 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-647a4fb2-639f-4a01-bc7b-1190e14a0b99 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:27.669674 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-647a4fb2-639f-4a01-bc7b-1190e14a0b99 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:27.670441 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-647a4fb2-639f-4a01-bc7b-1190e14a0b99 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:27.670898 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-647a4fb2-639f-4a01-bc7b-1190e14a0b99 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:27.799627 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-647a4fb2-639f-4a01-bc7b-1190e14a0b99 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:27.807558 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-647a4fb2-639f-4a01-bc7b-1190e14a0b99 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.148655 Dec 15 11:32:27.808118 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 174/343] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:27 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:28.193178 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4d325962-b5b5-4f10-87f7-ce56ad39394f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:28.193787 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4d325962-b5b5-4f10-87f7-ce56ad39394f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:28.199778 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d325962-b5b5-4f10-87f7-ce56ad39394f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:28.200198 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d325962-b5b5-4f10-87f7-ce56ad39394f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:28.200964 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d325962-b5b5-4f10-87f7-ce56ad39394f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:28.201392 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4d325962-b5b5-4f10-87f7-ce56ad39394f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:28.332435 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4d325962-b5b5-4f10-87f7-ce56ad39394f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:28.340586 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4d325962-b5b5-4f10-87f7-ce56ad39394f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:28.342159 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4d325962-b5b5-4f10-87f7-ce56ad39394f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:28.343316 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4d325962-b5b5-4f10-87f7-ce56ad39394f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1742 microversion: 2.20 time: 0.154559 Dec 15 11:32:28.343862 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 170/344] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:28 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:28.654185 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f9bca197-0bd1-432b-85e3-85a70a099322 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:28.654741 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f9bca197-0bd1-432b-85e3-85a70a099322 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:28.660687 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f9bca197-0bd1-432b-85e3-85a70a099322 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:28.661125 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f9bca197-0bd1-432b-85e3-85a70a099322 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:28.661889 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f9bca197-0bd1-432b-85e3-85a70a099322 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:28.662316 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f9bca197-0bd1-432b-85e3-85a70a099322 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:28.792402 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f9bca197-0bd1-432b-85e3-85a70a099322 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:28.800762 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f9bca197-0bd1-432b-85e3-85a70a099322 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.150317 Dec 15 11:32:28.801308 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 175/345] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:28 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:28.824957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8eafa3c8-dd2c-40ab-b96b-841c7a365f00 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:28.825602 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8eafa3c8-dd2c-40ab-b96b-841c7a365f00 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:28.832297 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8eafa3c8-dd2c-40ab-b96b-841c7a365f00 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:28.832747 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8eafa3c8-dd2c-40ab-b96b-841c7a365f00 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:28.833523 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8eafa3c8-dd2c-40ab-b96b-841c7a365f00 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:28.833955 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8eafa3c8-dd2c-40ab-b96b-841c7a365f00 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:28.959933 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8eafa3c8-dd2c-40ab-b96b-841c7a365f00 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:28.967961 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8eafa3c8-dd2c-40ab-b96b-841c7a365f00 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.146590 Dec 15 11:32:28.968531 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 171/346] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:28 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:29.361565 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e5c48987-45c2-461e-a2f9-8f43b389f00d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:29.362170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e5c48987-45c2-461e-a2f9-8f43b389f00d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:29.368051 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5c48987-45c2-461e-a2f9-8f43b389f00d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:29.368493 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5c48987-45c2-461e-a2f9-8f43b389f00d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:29.369266 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5c48987-45c2-461e-a2f9-8f43b389f00d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:29.369697 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5c48987-45c2-461e-a2f9-8f43b389f00d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:29.497190 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e5c48987-45c2-461e-a2f9-8f43b389f00d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:29.504853 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e5c48987-45c2-461e-a2f9-8f43b389f00d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:29.506327 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e5c48987-45c2-461e-a2f9-8f43b389f00d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:29.507494 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e5c48987-45c2-461e-a2f9-8f43b389f00d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1742 microversion: 2.20 time: 0.150192 Dec 15 11:32:29.508044 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 176/347] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:29 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1742 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:29.818453 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8855475b-3025-4b77-a189-21e8e2e621f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:29.819084 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8855475b-3025-4b77-a189-21e8e2e621f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:29.824892 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8855475b-3025-4b77-a189-21e8e2e621f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:29.825333 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8855475b-3025-4b77-a189-21e8e2e621f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:29.826095 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8855475b-3025-4b77-a189-21e8e2e621f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:29.826519 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8855475b-3025-4b77-a189-21e8e2e621f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:29.952988 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8855475b-3025-4b77-a189-21e8e2e621f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:29.961335 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8855475b-3025-4b77-a189-21e8e2e621f6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.146509 Dec 15 11:32:29.961890 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 172/348] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:29 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:29.984766 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8ecc0650-52e4-49a0-8af3-23acbd116587 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:29.985394 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8ecc0650-52e4-49a0-8af3-23acbd116587 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:29.991579 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ecc0650-52e4-49a0-8af3-23acbd116587 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:29.992021 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ecc0650-52e4-49a0-8af3-23acbd116587 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:29.992779 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ecc0650-52e4-49a0-8af3-23acbd116587 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:29.993207 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ecc0650-52e4-49a0-8af3-23acbd116587 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:30.120396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8ecc0650-52e4-49a0-8af3-23acbd116587 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:30.128774 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8ecc0650-52e4-49a0-8af3-23acbd116587 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1721 microversion: 2.1 time: 0.147555 Dec 15 11:32:30.129343 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 177/349] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:29 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:30.525845 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c302ed67-e14e-483d-be4c-1a6d4a4636af tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:30.526449 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c302ed67-e14e-483d-be4c-1a6d4a4636af tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:30.532355 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c302ed67-e14e-483d-be4c-1a6d4a4636af tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:30.532806 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c302ed67-e14e-483d-be4c-1a6d4a4636af tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:30.533569 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c302ed67-e14e-483d-be4c-1a6d4a4636af tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:30.534000 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c302ed67-e14e-483d-be4c-1a6d4a4636af tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:30.662401 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c302ed67-e14e-483d-be4c-1a6d4a4636af tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:30.669997 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c302ed67-e14e-483d-be4c-1a6d4a4636af tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:30.671530 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c302ed67-e14e-483d-be4c-1a6d4a4636af tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:30.672669 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c302ed67-e14e-483d-be4c-1a6d4a4636af tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1742 microversion: 2.20 time: 0.150510 Dec 15 11:32:30.673824 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 173/350] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:30 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:30.978033 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a1ea0514-21c3-4fe1-b0fb-9ce844f3e592 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:30.978666 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a1ea0514-21c3-4fe1-b0fb-9ce844f3e592 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:30.984461 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1ea0514-21c3-4fe1-b0fb-9ce844f3e592 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:30.984898 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1ea0514-21c3-4fe1-b0fb-9ce844f3e592 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:30.985694 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1ea0514-21c3-4fe1-b0fb-9ce844f3e592 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:30.986119 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1ea0514-21c3-4fe1-b0fb-9ce844f3e592 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:31.123579 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a1ea0514-21c3-4fe1-b0fb-9ce844f3e592 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:31.131969 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a1ea0514-21c3-4fe1-b0fb-9ce844f3e592 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.157564 Dec 15 11:32:31.132542 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 178/351] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:30 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:31.145968 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5b453b52-a3a2-4d36-b5f0-c312e91b9916 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:31.146744 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5b453b52-a3a2-4d36-b5f0-c312e91b9916 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:31.153923 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b453b52-a3a2-4d36-b5f0-c312e91b9916 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:31.154407 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b453b52-a3a2-4d36-b5f0-c312e91b9916 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:31.155439 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b453b52-a3a2-4d36-b5f0-c312e91b9916 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:31.156102 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b453b52-a3a2-4d36-b5f0-c312e91b9916 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:31.291010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-5b453b52-a3a2-4d36-b5f0-c312e91b9916 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:31.299038 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5b453b52-a3a2-4d36-b5f0-c312e91b9916 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1698 microversion: 2.1 time: 0.157532 Dec 15 11:32:31.299612 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 174/352] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:31 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:31.316509 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-95b2f524-a086-4fa0-9615-a1a513857daf tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:32:31.322485 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-95b2f524-a086-4fa0-9615-a1a513857daf tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:31.322976 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-95b2f524-a086-4fa0-9615-a1a513857daf tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:31.385437 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-95b2f524-a086-4fa0-9615-a1a513857daf tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Going to try to start instance {{(pid=116083) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 11:32:31.433174 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-95b2f524-a086-4fa0-9615-a1a513857daf tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 202 len: 0 microversion: 2.1 time: 0.121266 Dec 15 11:32:31.436761 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 179/353] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:32:31 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:32:31.442490 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-86029bf3-fa81-4264-8ff8-d2eeab5e27b8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:31.443290 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-86029bf3-fa81-4264-8ff8-d2eeab5e27b8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:31.449322 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-86029bf3-fa81-4264-8ff8-d2eeab5e27b8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:31.449963 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-86029bf3-fa81-4264-8ff8-d2eeab5e27b8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:31.450967 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-86029bf3-fa81-4264-8ff8-d2eeab5e27b8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:31.451398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-86029bf3-fa81-4264-8ff8-d2eeab5e27b8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:31.623676 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-86029bf3-fa81-4264-8ff8-d2eeab5e27b8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:31.632518 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-86029bf3-fa81-4264-8ff8-d2eeab5e27b8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1707 microversion: 2.1 time: 0.194228 Dec 15 11:32:31.633325 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 175/354] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:31 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1707 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:31.692019 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fe0d7f28-1adb-450f-83d0-66bbef78962d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:31.692716 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fe0d7f28-1adb-450f-83d0-66bbef78962d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:31.699061 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe0d7f28-1adb-450f-83d0-66bbef78962d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:31.699755 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe0d7f28-1adb-450f-83d0-66bbef78962d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:31.700784 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe0d7f28-1adb-450f-83d0-66bbef78962d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:31.701218 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe0d7f28-1adb-450f-83d0-66bbef78962d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:31.881326 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fe0d7f28-1adb-450f-83d0-66bbef78962d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:31.890991 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fe0d7f28-1adb-450f-83d0-66bbef78962d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:31.893010 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fe0d7f28-1adb-450f-83d0-66bbef78962d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:31.894331 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fe0d7f28-1adb-450f-83d0-66bbef78962d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1737 microversion: 2.20 time: 0.207675 Dec 15 11:32:31.895122 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 180/355] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:31 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:32.157874 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-91be49ab-746b-4512-9d53-559add9f4dab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:32.158487 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-91be49ab-746b-4512-9d53-559add9f4dab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:32.164728 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-91be49ab-746b-4512-9d53-559add9f4dab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:32.165556 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-91be49ab-746b-4512-9d53-559add9f4dab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:32.166419 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-91be49ab-746b-4512-9d53-559add9f4dab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:32.166949 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-91be49ab-746b-4512-9d53-559add9f4dab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:32.326919 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-91be49ab-746b-4512-9d53-559add9f4dab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:32.335564 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-91be49ab-746b-4512-9d53-559add9f4dab tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.182181 Dec 15 11:32:32.336370 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 176/356] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:32 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:32.651363 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f3704e96-c808-4860-a010-1a30e94d9d21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:32.652674 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f3704e96-c808-4860-a010-1a30e94d9d21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:32.661712 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f3704e96-c808-4860-a010-1a30e94d9d21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:32.662535 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f3704e96-c808-4860-a010-1a30e94d9d21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:32.663518 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f3704e96-c808-4860-a010-1a30e94d9d21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:32.664337 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f3704e96-c808-4860-a010-1a30e94d9d21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:32.778552 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-c2c609e5-857a-48f2-a54f-86706b3c19a5 req-8daa3302-ad7d-4368-8620-e195bae64525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0866db17-45ec-4550-b834-8880e974be1d", "name": "network-vif-plugged", "status": "completed", "tag": "b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:32:32.780514 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:32:32.780514 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:32:32.796393 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-c2c609e5-857a-48f2-a54f-86706b3c19a5 req-8daa3302-ad7d-4368-8620-e195bae64525 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:32.796843 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-c2c609e5-857a-48f2-a54f-86706b3c19a5 req-8daa3302-ad7d-4368-8620-e195bae64525 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:32.845386 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-c2c609e5-857a-48f2-a54f-86706b3c19a5 req-8daa3302-ad7d-4368-8620-e195bae64525 service nova] Creating event network-vif-plugged:b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d for instance 0866db17-45ec-4550-b834-8880e974be1d on hv-cinder-81321 Dec 15 11:32:32.848981 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-c2c609e5-857a-48f2-a54f-86706b3c19a5 req-8daa3302-ad7d-4368-8620-e195bae64525 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074600 Dec 15 11:32:32.850243 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 177/357] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:32:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:32:32.913933 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e6ab6869-8ccb-4255-b3d4-df1a8c324a8b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:32.914957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e6ab6869-8ccb-4255-b3d4-df1a8c324a8b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:32.947537 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6ab6869-8ccb-4255-b3d4-df1a8c324a8b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:32.948270 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6ab6869-8ccb-4255-b3d4-df1a8c324a8b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:32.949239 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6ab6869-8ccb-4255-b3d4-df1a8c324a8b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:32.949842 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6ab6869-8ccb-4255-b3d4-df1a8c324a8b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:33.123518 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f3704e96-c808-4860-a010-1a30e94d9d21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:33.133190 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f3704e96-c808-4860-a010-1a30e94d9d21 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1707 microversion: 2.1 time: 0.485300 Dec 15 11:32:33.134338 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 181/358] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:32 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1707 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:33.171333 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e6ab6869-8ccb-4255-b3d4-df1a8c324a8b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:33.193949 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e6ab6869-8ccb-4255-b3d4-df1a8c324a8b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:33.203499 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e6ab6869-8ccb-4255-b3d4-df1a8c324a8b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:33.207804 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e6ab6869-8ccb-4255-b3d4-df1a8c324a8b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1737 microversion: 2.20 time: 0.297960 Dec 15 11:32:33.216163 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 178/359] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:32 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1737 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:32:33.357130 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f8ff73fc-6dc4-4885-bf3c-839d58d2f288 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:33.357686 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f8ff73fc-6dc4-4885-bf3c-839d58d2f288 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:33.366093 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8ff73fc-6dc4-4885-bf3c-839d58d2f288 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:33.366537 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8ff73fc-6dc4-4885-bf3c-839d58d2f288 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:33.367408 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8ff73fc-6dc4-4885-bf3c-839d58d2f288 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:33.368239 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8ff73fc-6dc4-4885-bf3c-839d58d2f288 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:33.511484 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f8ff73fc-6dc4-4885-bf3c-839d58d2f288 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:33.520631 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f8ff73fc-6dc4-4885-bf3c-839d58d2f288 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.167865 Dec 15 11:32:33.521255 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 182/360] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:33 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:34.151610 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a10eb5c2-d190-4950-b03f-5014dfa4d078 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:34.152511 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a10eb5c2-d190-4950-b03f-5014dfa4d078 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:34.160739 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a10eb5c2-d190-4950-b03f-5014dfa4d078 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:34.161441 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a10eb5c2-d190-4950-b03f-5014dfa4d078 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:34.162381 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a10eb5c2-d190-4950-b03f-5014dfa4d078 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:34.162998 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a10eb5c2-d190-4950-b03f-5014dfa4d078 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:34.227238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-efd15e92-95ee-497f-a808-a0c5720fa0f1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:34.228600 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-efd15e92-95ee-497f-a808-a0c5720fa0f1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:34.240028 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-efd15e92-95ee-497f-a808-a0c5720fa0f1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:34.240861 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-efd15e92-95ee-497f-a808-a0c5720fa0f1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:34.241760 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-efd15e92-95ee-497f-a808-a0c5720fa0f1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:34.242450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-efd15e92-95ee-497f-a808-a0c5720fa0f1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:34.384982 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a10eb5c2-d190-4950-b03f-5014dfa4d078 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:34.397896 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a10eb5c2-d190-4950-b03f-5014dfa4d078 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1711 microversion: 2.1 time: 0.250036 Dec 15 11:32:34.410242 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 179/361] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:34 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1711 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:34.419113 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-efd15e92-95ee-497f-a808-a0c5720fa0f1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:34.428589 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-efd15e92-95ee-497f-a808-a0c5720fa0f1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:34.430413 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-efd15e92-95ee-497f-a808-a0c5720fa0f1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:34.431879 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-efd15e92-95ee-497f-a808-a0c5720fa0f1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1737 microversion: 2.20 time: 0.208811 Dec 15 11:32:34.434915 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 183/362] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:34 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:32:34.538237 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7ea172af-0d4e-4c61-8467-5e50614fc3b2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:34.538867 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7ea172af-0d4e-4c61-8467-5e50614fc3b2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:34.552884 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7ea172af-0d4e-4c61-8467-5e50614fc3b2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:34.553513 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7ea172af-0d4e-4c61-8467-5e50614fc3b2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:34.554398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7ea172af-0d4e-4c61-8467-5e50614fc3b2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:34.554882 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7ea172af-0d4e-4c61-8467-5e50614fc3b2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:34.767517 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7ea172af-0d4e-4c61-8467-5e50614fc3b2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:34.777916 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7ea172af-0d4e-4c61-8467-5e50614fc3b2 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.243786 Dec 15 11:32:34.778701 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 180/363] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:34 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:35.451774 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2102112e-429d-4a8f-82e9-56f1e91ac819 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:35.453331 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2102112e-429d-4a8f-82e9-56f1e91ac819 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:35.463860 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2102112e-429d-4a8f-82e9-56f1e91ac819 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:35.464452 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2102112e-429d-4a8f-82e9-56f1e91ac819 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:35.466195 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2102112e-429d-4a8f-82e9-56f1e91ac819 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:35.466903 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2102112e-429d-4a8f-82e9-56f1e91ac819 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:35.619423 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2102112e-429d-4a8f-82e9-56f1e91ac819 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:35.632667 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2102112e-429d-4a8f-82e9-56f1e91ac819 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:35.634468 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2102112e-429d-4a8f-82e9-56f1e91ac819 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:35.635923 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2102112e-429d-4a8f-82e9-56f1e91ac819 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1737 microversion: 2.20 time: 0.189480 Dec 15 11:32:35.637119 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 184/364] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:35 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:35.797086 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0a82d3d5-2d6c-45af-a49b-5752e37f08e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:35.797697 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-0a82d3d5-2d6c-45af-a49b-5752e37f08e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:35.818966 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0a82d3d5-2d6c-45af-a49b-5752e37f08e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:35.819471 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0a82d3d5-2d6c-45af-a49b-5752e37f08e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:35.820308 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0a82d3d5-2d6c-45af-a49b-5752e37f08e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:35.821578 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0a82d3d5-2d6c-45af-a49b-5752e37f08e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:36.033539 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-0a82d3d5-2d6c-45af-a49b-5752e37f08e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:36.043792 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0a82d3d5-2d6c-45af-a49b-5752e37f08e3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.250835 Dec 15 11:32:36.045004 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 181/365] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:35 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:36.656153 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1f06d4fc-72d8-46ee-8d7a-6b5fa48dbf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:36.656753 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1f06d4fc-72d8-46ee-8d7a-6b5fa48dbf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:36.663260 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1f06d4fc-72d8-46ee-8d7a-6b5fa48dbf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:36.663695 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1f06d4fc-72d8-46ee-8d7a-6b5fa48dbf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:36.664475 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1f06d4fc-72d8-46ee-8d7a-6b5fa48dbf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:36.675503 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1f06d4fc-72d8-46ee-8d7a-6b5fa48dbf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:36.920996 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1f06d4fc-72d8-46ee-8d7a-6b5fa48dbf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:36.943130 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1f06d4fc-72d8-46ee-8d7a-6b5fa48dbf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:36.946652 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1f06d4fc-72d8-46ee-8d7a-6b5fa48dbf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:36.948349 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1f06d4fc-72d8-46ee-8d7a-6b5fa48dbf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1737 microversion: 2.20 time: 0.296141 Dec 15 11:32:36.950392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 185/366] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:36 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:37.065424 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-079f1ba5-0832-49e0-89fd-f7710f532aa7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:37.067360 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-079f1ba5-0832-49e0-89fd-f7710f532aa7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:37.085238 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-079f1ba5-0832-49e0-89fd-f7710f532aa7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:37.087133 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-079f1ba5-0832-49e0-89fd-f7710f532aa7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:37.088472 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-079f1ba5-0832-49e0-89fd-f7710f532aa7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:37.089210 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-079f1ba5-0832-49e0-89fd-f7710f532aa7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:37.371840 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-079f1ba5-0832-49e0-89fd-f7710f532aa7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:37.383077 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-079f1ba5-0832-49e0-89fd-f7710f532aa7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.322459 Dec 15 11:32:37.393685 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 182/367] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:37 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:37.969396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ee5adf60-ca04-49f5-8b85-54bdf5ef7fc1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:37.970079 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ee5adf60-ca04-49f5-8b85-54bdf5ef7fc1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:37.993444 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee5adf60-ca04-49f5-8b85-54bdf5ef7fc1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:38.005171 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee5adf60-ca04-49f5-8b85-54bdf5ef7fc1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:38.006469 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee5adf60-ca04-49f5-8b85-54bdf5ef7fc1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:38.007108 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee5adf60-ca04-49f5-8b85-54bdf5ef7fc1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:38.193863 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ee5adf60-ca04-49f5-8b85-54bdf5ef7fc1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:38.204220 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ee5adf60-ca04-49f5-8b85-54bdf5ef7fc1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:38.206041 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ee5adf60-ca04-49f5-8b85-54bdf5ef7fc1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:38.207559 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ee5adf60-ca04-49f5-8b85-54bdf5ef7fc1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1737 microversion: 2.20 time: 0.242010 Dec 15 11:32:38.219123 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 186/368] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:37 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:38.401449 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-1a522df7-705f-41f0-a084-37eac36cd40b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:38.402084 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-1a522df7-705f-41f0-a084-37eac36cd40b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:38.410317 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a522df7-705f-41f0-a084-37eac36cd40b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:38.410819 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a522df7-705f-41f0-a084-37eac36cd40b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:38.411604 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a522df7-705f-41f0-a084-37eac36cd40b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:38.412045 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a522df7-705f-41f0-a084-37eac36cd40b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:38.578506 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-1a522df7-705f-41f0-a084-37eac36cd40b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:38.588404 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-1a522df7-705f-41f0-a084-37eac36cd40b tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.191441 Dec 15 11:32:38.589093 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 183/369] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:38 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:39.225867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-90c1110e-bab2-4d1c-8418-bad1ccfe3f25 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:39.226463 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-90c1110e-bab2-4d1c-8418-bad1ccfe3f25 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:39.232488 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90c1110e-bab2-4d1c-8418-bad1ccfe3f25 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:39.233202 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90c1110e-bab2-4d1c-8418-bad1ccfe3f25 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:39.234541 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90c1110e-bab2-4d1c-8418-bad1ccfe3f25 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:39.235192 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90c1110e-bab2-4d1c-8418-bad1ccfe3f25 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:39.401926 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-90c1110e-bab2-4d1c-8418-bad1ccfe3f25 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:39.410990 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-90c1110e-bab2-4d1c-8418-bad1ccfe3f25 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:39.412711 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-90c1110e-bab2-4d1c-8418-bad1ccfe3f25 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:39.413963 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-90c1110e-bab2-4d1c-8418-bad1ccfe3f25 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1737 microversion: 2.20 time: 0.192506 Dec 15 11:32:39.414614 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 187/370] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:39 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:32:39.606873 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-9d827ae7-2191-49b4-ab8f-79c20da8ca11 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:39.607773 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-9d827ae7-2191-49b4-ab8f-79c20da8ca11 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:39.614608 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9d827ae7-2191-49b4-ab8f-79c20da8ca11 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:39.615177 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9d827ae7-2191-49b4-ab8f-79c20da8ca11 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:39.616230 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9d827ae7-2191-49b4-ab8f-79c20da8ca11 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:39.617528 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9d827ae7-2191-49b4-ab8f-79c20da8ca11 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:39.770522 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9d827ae7-2191-49b4-ab8f-79c20da8ca11 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:39.781169 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-9d827ae7-2191-49b4-ab8f-79c20da8ca11 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.178033 Dec 15 11:32:39.791726 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 184/371] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:39 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:40.433805 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c09aba74-2dc5-4e7c-a4b5-00258cdd5db6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:40.434506 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c09aba74-2dc5-4e7c-a4b5-00258cdd5db6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:40.444589 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c09aba74-2dc5-4e7c-a4b5-00258cdd5db6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:40.445659 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c09aba74-2dc5-4e7c-a4b5-00258cdd5db6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:40.447044 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c09aba74-2dc5-4e7c-a4b5-00258cdd5db6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:40.448059 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c09aba74-2dc5-4e7c-a4b5-00258cdd5db6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:40.663454 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c09aba74-2dc5-4e7c-a4b5-00258cdd5db6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:40.672436 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c09aba74-2dc5-4e7c-a4b5-00258cdd5db6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:40.674682 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c09aba74-2dc5-4e7c-a4b5-00258cdd5db6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:40.675949 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c09aba74-2dc5-4e7c-a4b5-00258cdd5db6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1737 microversion: 2.20 time: 0.246371 Dec 15 11:32:40.676575 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 188/372] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:40 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:40.799910 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-252fa5e8-a5d4-4e42-bb08-b30e45244ae4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:40.800893 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-252fa5e8-a5d4-4e42-bb08-b30e45244ae4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:40.810137 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-252fa5e8-a5d4-4e42-bb08-b30e45244ae4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:40.811318 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-252fa5e8-a5d4-4e42-bb08-b30e45244ae4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:40.812815 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-252fa5e8-a5d4-4e42-bb08-b30e45244ae4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:40.814813 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-252fa5e8-a5d4-4e42-bb08-b30e45244ae4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:40.969143 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-252fa5e8-a5d4-4e42-bb08-b30e45244ae4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:40.982815 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-252fa5e8-a5d4-4e42-bb08-b30e45244ae4 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.184495 Dec 15 11:32:40.982815 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 185/373] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:40 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:41.696898 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3e955cc8-7b40-466c-b7f7-d1435b94b8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:41.703558 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3e955cc8-7b40-466c-b7f7-d1435b94b8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:41.729487 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e955cc8-7b40-466c-b7f7-d1435b94b8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:41.730180 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e955cc8-7b40-466c-b7f7-d1435b94b8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:41.731651 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e955cc8-7b40-466c-b7f7-d1435b94b8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:41.732245 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e955cc8-7b40-466c-b7f7-d1435b94b8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:41.916149 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3e955cc8-7b40-466c-b7f7-d1435b94b8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:41.937624 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3e955cc8-7b40-466c-b7f7-d1435b94b8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:41.939864 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3e955cc8-7b40-466c-b7f7-d1435b94b8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:41.941517 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3e955cc8-7b40-466c-b7f7-d1435b94b8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1737 microversion: 2.20 time: 0.248368 Dec 15 11:32:41.951744 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 189/374] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:41 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:42.001434 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ffed2c47-e494-4121-acdb-39d0b7d3d8d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:42.014697 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-ffed2c47-e494-4121-acdb-39d0b7d3d8d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:42.029749 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ffed2c47-e494-4121-acdb-39d0b7d3d8d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:42.030672 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ffed2c47-e494-4121-acdb-39d0b7d3d8d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:42.031705 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ffed2c47-e494-4121-acdb-39d0b7d3d8d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:42.032579 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ffed2c47-e494-4121-acdb-39d0b7d3d8d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:42.325746 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ffed2c47-e494-4121-acdb-39d0b7d3d8d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:42.335801 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ffed2c47-e494-4121-acdb-39d0b7d3d8d1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.338774 Dec 15 11:32:42.336515 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 186/375] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:41 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:42.964443 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-976a872f-655d-4a24-aea9-94d4ecc6885c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:42.965043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-976a872f-655d-4a24-aea9-94d4ecc6885c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:42.972437 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-976a872f-655d-4a24-aea9-94d4ecc6885c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:42.979867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-976a872f-655d-4a24-aea9-94d4ecc6885c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:42.980904 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-976a872f-655d-4a24-aea9-94d4ecc6885c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:42.981336 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-976a872f-655d-4a24-aea9-94d4ecc6885c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:43.162031 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-976a872f-655d-4a24-aea9-94d4ecc6885c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:43.170708 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-976a872f-655d-4a24-aea9-94d4ecc6885c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:43.172090 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-976a872f-655d-4a24-aea9-94d4ecc6885c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:43.174597 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-976a872f-655d-4a24-aea9-94d4ecc6885c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1737 microversion: 2.20 time: 0.214880 Dec 15 11:32:43.186365 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 190/376] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:42 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:43.354287 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b55ea43c-768e-454d-86fa-7b4a6021514e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:43.355584 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b55ea43c-768e-454d-86fa-7b4a6021514e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:43.362757 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b55ea43c-768e-454d-86fa-7b4a6021514e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:43.363203 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b55ea43c-768e-454d-86fa-7b4a6021514e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:43.363994 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b55ea43c-768e-454d-86fa-7b4a6021514e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:43.364423 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b55ea43c-768e-454d-86fa-7b4a6021514e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:43.607460 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b55ea43c-768e-454d-86fa-7b4a6021514e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:43.622965 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b55ea43c-768e-454d-86fa-7b4a6021514e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1565 microversion: 2.1 time: 0.272153 Dec 15 11:32:43.623572 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 187/377] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:43 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1565 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:44.193987 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d27e72af-49af-4a6d-a7bd-d91d5541986e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:44.194780 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d27e72af-49af-4a6d-a7bd-d91d5541986e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:44.200884 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d27e72af-49af-4a6d-a7bd-d91d5541986e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:44.201340 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d27e72af-49af-4a6d-a7bd-d91d5541986e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:44.202109 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d27e72af-49af-4a6d-a7bd-d91d5541986e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:44.202534 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d27e72af-49af-4a6d-a7bd-d91d5541986e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:44.356711 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d27e72af-49af-4a6d-a7bd-d91d5541986e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:44.365555 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d27e72af-49af-4a6d-a7bd-d91d5541986e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:44.367060 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d27e72af-49af-4a6d-a7bd-d91d5541986e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:44.368198 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d27e72af-49af-4a6d-a7bd-d91d5541986e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1719 microversion: 2.20 time: 0.178382 Dec 15 11:32:44.368751 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 191/378] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:44 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:44.640255 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c21bb405-8cbb-45aa-af7d-f2631e9a8c63 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:44.640852 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c21bb405-8cbb-45aa-af7d-f2631e9a8c63 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:44.647842 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c21bb405-8cbb-45aa-af7d-f2631e9a8c63 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:44.648281 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c21bb405-8cbb-45aa-af7d-f2631e9a8c63 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:44.649053 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c21bb405-8cbb-45aa-af7d-f2631e9a8c63 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:44.649480 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c21bb405-8cbb-45aa-af7d-f2631e9a8c63 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:44.784763 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c21bb405-8cbb-45aa-af7d-f2631e9a8c63 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:44.792660 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c21bb405-8cbb-45aa-af7d-f2631e9a8c63 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1545 microversion: 2.1 time: 0.156043 Dec 15 11:32:44.793221 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 188/379] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:44 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1545 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:44.812441 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-22867a63-f80f-4ef2-8c23-96cfd380dcae tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:44.812923 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-22867a63-f80f-4ef2-8c23-96cfd380dcae tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:44.819994 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22867a63-f80f-4ef2-8c23-96cfd380dcae tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:44.820520 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22867a63-f80f-4ef2-8c23-96cfd380dcae tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:44.821296 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22867a63-f80f-4ef2-8c23-96cfd380dcae tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:44.821724 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22867a63-f80f-4ef2-8c23-96cfd380dcae tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:44.958908 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-22867a63-f80f-4ef2-8c23-96cfd380dcae tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] HTTP exception thrown: Cannot 'detach_volume' instance 9c2f09d7-6122-484a-b99c-33d451ae87a9 while it is in vm_state rescued Dec 15 11:32:44.959817 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-22867a63-f80f-4ef2-8c23-96cfd380dcae tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Returning 409 to user: Cannot 'detach_volume' instance 9c2f09d7-6122-484a-b99c-33d451ae87a9 while it is in vm_state rescued {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:32:44.961035 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-22867a63-f80f-4ef2-8c23-96cfd380dcae tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments/4de94aef-8522-4944-942d-d5ac0735647f" status: 409 len: 152 microversion: 2.1 time: 0.153272 Dec 15 11:32:44.961598 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 192/380] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:32:44 2021] DELETE /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments/4de94aef-8522-4944-942d-d5ac0735647f => generated 152 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 15 11:32:44.970161 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e98a5286-7a46-4294-acfc-e723c817b2c5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:32:44.970888 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e98a5286-7a46-4294-acfc-e723c817b2c5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:44.976733 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e98a5286-7a46-4294-acfc-e723c817b2c5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:44.977184 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e98a5286-7a46-4294-acfc-e723c817b2c5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:44.977983 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e98a5286-7a46-4294-acfc-e723c817b2c5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:44.978417 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e98a5286-7a46-4294-acfc-e723c817b2c5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:45.049404 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e98a5286-7a46-4294-acfc-e723c817b2c5 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/action" status: 202 len: 0 microversion: 2.1 time: 0.082786 Dec 15 11:32:45.049944 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 189/381] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:32:44 2021] POST /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:32:45.058519 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f267894b-63f9-44c7-8243-c3aa93db5f7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:45.059158 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f267894b-63f9-44c7-8243-c3aa93db5f7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:45.066259 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f267894b-63f9-44c7-8243-c3aa93db5f7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:45.066935 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f267894b-63f9-44c7-8243-c3aa93db5f7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:45.067728 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f267894b-63f9-44c7-8243-c3aa93db5f7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:45.068175 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f267894b-63f9-44c7-8243-c3aa93db5f7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:45.219447 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f267894b-63f9-44c7-8243-c3aa93db5f7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:45.230766 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f267894b-63f9-44c7-8243-c3aa93db5f7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1553 microversion: 2.1 time: 0.175871 Dec 15 11:32:45.231841 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 193/382] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:45 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:45.390907 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-44f46c8d-522f-42e5-ad93-4a063fd3ead1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:45.391614 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-44f46c8d-522f-42e5-ad93-4a063fd3ead1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:45.398772 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-44f46c8d-522f-42e5-ad93-4a063fd3ead1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:45.399225 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-44f46c8d-522f-42e5-ad93-4a063fd3ead1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:45.400008 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-44f46c8d-522f-42e5-ad93-4a063fd3ead1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:45.400442 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-44f46c8d-522f-42e5-ad93-4a063fd3ead1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:45.629243 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-44f46c8d-522f-42e5-ad93-4a063fd3ead1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:45.637085 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-44f46c8d-522f-42e5-ad93-4a063fd3ead1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:45.638623 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-44f46c8d-522f-42e5-ad93-4a063fd3ead1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:45.639766 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-44f46c8d-522f-42e5-ad93-4a063fd3ead1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1719 microversion: 2.20 time: 0.253179 Dec 15 11:32:45.640522 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 190/383] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:45 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1719 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:46.248923 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-990dfb23-554a-4bf2-9ef8-ac4e03f568f1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:46.249507 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-990dfb23-554a-4bf2-9ef8-ac4e03f568f1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:46.255986 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-990dfb23-554a-4bf2-9ef8-ac4e03f568f1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:46.256677 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-990dfb23-554a-4bf2-9ef8-ac4e03f568f1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:46.257318 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-990dfb23-554a-4bf2-9ef8-ac4e03f568f1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:46.257788 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-990dfb23-554a-4bf2-9ef8-ac4e03f568f1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:46.389970 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-990dfb23-554a-4bf2-9ef8-ac4e03f568f1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:46.398419 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-990dfb23-554a-4bf2-9ef8-ac4e03f568f1 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1553 microversion: 2.1 time: 0.153065 Dec 15 11:32:46.399018 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 194/384] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:46 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:46.657511 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-cd9619e1-5a6c-402c-b3ef-9d7d19de7ef3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:46.658315 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-cd9619e1-5a6c-402c-b3ef-9d7d19de7ef3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:46.664937 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd9619e1-5a6c-402c-b3ef-9d7d19de7ef3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:46.665461 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd9619e1-5a6c-402c-b3ef-9d7d19de7ef3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:46.666318 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd9619e1-5a6c-402c-b3ef-9d7d19de7ef3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:46.666849 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd9619e1-5a6c-402c-b3ef-9d7d19de7ef3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:46.772638 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-78bb93b4-84fc-4cf8-b285-bf6d8833d935 req-73e0be52-35f7-49bd-80ea-bc179d7b35c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0866db17-45ec-4550-b834-8880e974be1d", "name": "network-vif-unplugged", "status": "completed", "tag": "b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:32:46.775234 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:32:46.775234 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:32:46.782838 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-78bb93b4-84fc-4cf8-b285-bf6d8833d935 req-73e0be52-35f7-49bd-80ea-bc179d7b35c1 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:46.783289 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-78bb93b4-84fc-4cf8-b285-bf6d8833d935 req-73e0be52-35f7-49bd-80ea-bc179d7b35c1 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:46.797421 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.compute.server_external_events [req-78bb93b4-84fc-4cf8-b285-bf6d8833d935 req-73e0be52-35f7-49bd-80ea-bc179d7b35c1 service nova] Unable to find a host for instance 0866db17-45ec-4550-b834-8880e974be1d. Dropping event network-vif-unplugged {{(pid=116083) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 15 11:32:46.798880 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-78bb93b4-84fc-4cf8-b285-bf6d8833d935 req-73e0be52-35f7-49bd-80ea-bc179d7b35c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036302 Dec 15 11:32:46.799521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 195/385] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:32:46 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 15 11:32:46.827922 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-cd9619e1-5a6c-402c-b3ef-9d7d19de7ef3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:46.843356 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-cd9619e1-5a6c-402c-b3ef-9d7d19de7ef3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:46.844952 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-cd9619e1-5a6c-402c-b3ef-9d7d19de7ef3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:46.846124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-cd9619e1-5a6c-402c-b3ef-9d7d19de7ef3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1662 microversion: 2.20 time: 0.192752 Dec 15 11:32:46.846728 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 191/386] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:46 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1662 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:46.864871 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5202b054-ab29-494b-bbf4-232b7bb10a8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30f14f1b-b57b-45e0-b2e6-f3b6f0d40b77"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:32:46.866088 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5202b054-ab29-494b-bbf4-232b7bb10a8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:46.872279 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5202b054-ab29-494b-bbf4-232b7bb10a8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:46.872746 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5202b054-ab29-494b-bbf4-232b7bb10a8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:46.873532 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5202b054-ab29-494b-bbf4-232b7bb10a8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:46.873969 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5202b054-ab29-494b-bbf4-232b7bb10a8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:47.146917 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5202b054-ab29-494b-bbf4-232b7bb10a8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287091 Dec 15 11:32:47.147581 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 196/387] 10.222.0.18 () {62 vars in 1363 bytes} [Wed Dec 15 11:32:46 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:32:47.267012 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b5f13a8b-af74-44f2-834a-02f796dd4dea tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:32:47.267589 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b5f13a8b-af74-44f2-834a-02f796dd4dea tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:47.273974 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b5f13a8b-af74-44f2-834a-02f796dd4dea tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:47.274730 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b5f13a8b-af74-44f2-834a-02f796dd4dea tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:47.275521 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b5f13a8b-af74-44f2-834a-02f796dd4dea tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:47.276120 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b5f13a8b-af74-44f2-834a-02f796dd4dea tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:47.384072 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b5f13a8b-af74-44f2-834a-02f796dd4dea tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action" status: 202 len: 0 microversion: 2.20 time: 0.121014 Dec 15 11:32:47.385967 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 192/388] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:32:47 2021] POST /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:32:47.398550 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-130fcbc8-ebe8-4035-b67a-f47f35039de9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:47.399185 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-130fcbc8-ebe8-4035-b67a-f47f35039de9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:47.406514 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-130fcbc8-ebe8-4035-b67a-f47f35039de9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:47.407745 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-130fcbc8-ebe8-4035-b67a-f47f35039de9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:47.408562 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-130fcbc8-ebe8-4035-b67a-f47f35039de9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:47.409181 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-130fcbc8-ebe8-4035-b67a-f47f35039de9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:47.415391 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-51d05c08-71d4-4cd0-903a-8443d907b8f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:47.415914 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-51d05c08-71d4-4cd0-903a-8443d907b8f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:47.430393 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-51d05c08-71d4-4cd0-903a-8443d907b8f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:47.431617 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-51d05c08-71d4-4cd0-903a-8443d907b8f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:47.432494 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-51d05c08-71d4-4cd0-903a-8443d907b8f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:47.432945 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-51d05c08-71d4-4cd0-903a-8443d907b8f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:47.596592 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-130fcbc8-ebe8-4035-b67a-f47f35039de9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:47.596987 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-51d05c08-71d4-4cd0-903a-8443d907b8f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:47.606523 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-51d05c08-71d4-4cd0-903a-8443d907b8f3 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1559 microversion: 2.1 time: 0.194792 Dec 15 11:32:47.606748 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-130fcbc8-ebe8-4035-b67a-f47f35039de9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:47.608289 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-130fcbc8-ebe8-4035-b67a-f47f35039de9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:47.609845 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-130fcbc8-ebe8-4035-b67a-f47f35039de9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1748 microversion: 2.20 time: 0.219986 Dec 15 11:32:47.610428 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 197/389] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:47 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1748 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:47.628213 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 193/390] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:47 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:47.675774 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b09c91e0-8afb-4360-9831-0f4184eaed06 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:47.676263 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b09c91e0-8afb-4360-9831-0f4184eaed06 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:47.682722 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b09c91e0-8afb-4360-9831-0f4184eaed06 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:47.683233 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b09c91e0-8afb-4360-9831-0f4184eaed06 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:47.684015 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b09c91e0-8afb-4360-9831-0f4184eaed06 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:47.684447 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b09c91e0-8afb-4360-9831-0f4184eaed06 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:47.765478 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-b09c91e0-8afb-4360-9831-0f4184eaed06 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lazy-loading 'services' on Instance uuid 9c2f09d7-6122-484a-b99c-33d451ae87a9 {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:32:47.899199 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b09c91e0-8afb-4360-9831-0f4184eaed06 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments/4de94aef-8522-4944-942d-d5ac0735647f" status: 202 len: 0 microversion: 2.1 time: 0.227119 Dec 15 11:32:47.899793 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 198/391] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:32:47 2021] DELETE /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments/4de94aef-8522-4944-942d-d5ac0735647f => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:32:47.908248 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-62df4027-8948-4e01-bbb1-83bb1ba81101 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:47.909279 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-62df4027-8948-4e01-bbb1-83bb1ba81101 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:47.916660 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62df4027-8948-4e01-bbb1-83bb1ba81101 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:47.917120 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62df4027-8948-4e01-bbb1-83bb1ba81101 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:47.918326 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62df4027-8948-4e01-bbb1-83bb1ba81101 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:47.919019 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62df4027-8948-4e01-bbb1-83bb1ba81101 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:47.953069 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-62df4027-8948-4e01-bbb1-83bb1ba81101 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048700 Dec 15 11:32:47.953957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 194/392] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:32:47 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:32:48.628965 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-244d6f4f-0570-4c70-abf3-7f12fa9b1406 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:48.629658 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-244d6f4f-0570-4c70-abf3-7f12fa9b1406 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:48.635986 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-244d6f4f-0570-4c70-abf3-7f12fa9b1406 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:48.636421 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-244d6f4f-0570-4c70-abf3-7f12fa9b1406 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:48.637193 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-244d6f4f-0570-4c70-abf3-7f12fa9b1406 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:48.637615 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-244d6f4f-0570-4c70-abf3-7f12fa9b1406 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:48.818120 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-244d6f4f-0570-4c70-abf3-7f12fa9b1406 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:48.828124 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-244d6f4f-0570-4c70-abf3-7f12fa9b1406 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:48.830082 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-244d6f4f-0570-4c70-abf3-7f12fa9b1406 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:48.831446 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-244d6f4f-0570-4c70-abf3-7f12fa9b1406 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1750 microversion: 2.20 time: 0.207016 Dec 15 11:32:48.833601 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 199/393] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:48 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1750 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:32:48.966283 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-66e2140c-88f0-4360-a92f-41945a13386e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:48.967368 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-66e2140c-88f0-4360-a92f-41945a13386e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:48.974094 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-66e2140c-88f0-4360-a92f-41945a13386e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:48.974543 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-66e2140c-88f0-4360-a92f-41945a13386e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:48.975354 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-66e2140c-88f0-4360-a92f-41945a13386e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:48.975962 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-66e2140c-88f0-4360-a92f-41945a13386e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:49.004884 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-66e2140c-88f0-4360-a92f-41945a13386e tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043036 Dec 15 11:32:49.005443 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 195/394] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:32:48 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:32:49.852522 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e66b2012-c246-4d35-8972-3e0b3666d34a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:49.853851 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e66b2012-c246-4d35-8972-3e0b3666d34a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:49.861059 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e66b2012-c246-4d35-8972-3e0b3666d34a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:49.861598 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e66b2012-c246-4d35-8972-3e0b3666d34a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:49.862483 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e66b2012-c246-4d35-8972-3e0b3666d34a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:49.863056 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e66b2012-c246-4d35-8972-3e0b3666d34a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:50.001499 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e66b2012-c246-4d35-8972-3e0b3666d34a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:50.014738 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e66b2012-c246-4d35-8972-3e0b3666d34a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:50.016222 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e66b2012-c246-4d35-8972-3e0b3666d34a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:50.018217 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e66b2012-c246-4d35-8972-3e0b3666d34a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.169393 Dec 15 11:32:50.018817 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 200/395] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:49 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:51.037398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-630096ef-5a0f-45dd-b19c-25c9e2804c8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:51.037902 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-630096ef-5a0f-45dd-b19c-25c9e2804c8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:51.046520 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-630096ef-5a0f-45dd-b19c-25c9e2804c8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:51.047248 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-630096ef-5a0f-45dd-b19c-25c9e2804c8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:51.048972 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-630096ef-5a0f-45dd-b19c-25c9e2804c8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:51.049567 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-630096ef-5a0f-45dd-b19c-25c9e2804c8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:51.227696 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-630096ef-5a0f-45dd-b19c-25c9e2804c8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:51.237321 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-630096ef-5a0f-45dd-b19c-25c9e2804c8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:51.239985 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-630096ef-5a0f-45dd-b19c-25c9e2804c8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:51.243027 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-630096ef-5a0f-45dd-b19c-25c9e2804c8f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.208304 Dec 15 11:32:51.245050 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 196/396] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:51 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:51.411028 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0b27bfed-bbd6-46e7-9611-83848c192b51 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:51.411541 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0b27bfed-bbd6-46e7-9611-83848c192b51 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:51.420720 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b27bfed-bbd6-46e7-9611-83848c192b51 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:51.421392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b27bfed-bbd6-46e7-9611-83848c192b51 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:51.422337 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b27bfed-bbd6-46e7-9611-83848c192b51 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:51.423588 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b27bfed-bbd6-46e7-9611-83848c192b51 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:51.457830 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0b27bfed-bbd6-46e7-9611-83848c192b51 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:32:51.599254 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0b27bfed-bbd6-46e7-9611-83848c192b51 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 204 len: 0 microversion: 2.1 time: 0.195125 Dec 15 11:32:51.600472 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 201/397] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:32:51 2021] DELETE /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:32:51.611606 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e2351b30-6397-4fc4-bfcd-a5e849b35461 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:51.612611 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e2351b30-6397-4fc4-bfcd-a5e849b35461 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:51.623752 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e2351b30-6397-4fc4-bfcd-a5e849b35461 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:51.624261 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e2351b30-6397-4fc4-bfcd-a5e849b35461 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:51.627060 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e2351b30-6397-4fc4-bfcd-a5e849b35461 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:51.627499 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e2351b30-6397-4fc4-bfcd-a5e849b35461 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:51.943580 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e2351b30-6397-4fc4-bfcd-a5e849b35461 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:51.965270 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e2351b30-6397-4fc4-bfcd-a5e849b35461 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.358831 Dec 15 11:32:51.977875 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 197/398] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:51 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:52.263594 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-096d21b8-fead-4925-8f6b-7c61b7444c3c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:52.264421 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-096d21b8-fead-4925-8f6b-7c61b7444c3c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:52.274904 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-096d21b8-fead-4925-8f6b-7c61b7444c3c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:52.278307 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-096d21b8-fead-4925-8f6b-7c61b7444c3c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:52.279258 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-096d21b8-fead-4925-8f6b-7c61b7444c3c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:52.284826 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-096d21b8-fead-4925-8f6b-7c61b7444c3c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:52.647528 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-096d21b8-fead-4925-8f6b-7c61b7444c3c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:52.661537 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-096d21b8-fead-4925-8f6b-7c61b7444c3c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:52.663384 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-096d21b8-fead-4925-8f6b-7c61b7444c3c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:52.666748 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-096d21b8-fead-4925-8f6b-7c61b7444c3c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.407447 Dec 15 11:32:52.669944 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 202/399] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:52 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:52.983250 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7c78a59e-d6a0-4c35-b547-308dfe24d09c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:52.984030 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7c78a59e-d6a0-4c35-b547-308dfe24d09c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:52.994644 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c78a59e-d6a0-4c35-b547-308dfe24d09c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:52.998059 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c78a59e-d6a0-4c35-b547-308dfe24d09c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:52.999260 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c78a59e-d6a0-4c35-b547-308dfe24d09c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:52.999928 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c78a59e-d6a0-4c35-b547-308dfe24d09c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:53.249655 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7c78a59e-d6a0-4c35-b547-308dfe24d09c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:53.263816 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7c78a59e-d6a0-4c35-b547-308dfe24d09c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.284822 Dec 15 11:32:53.265128 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 198/400] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:52 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:53.692573 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-792ca5b6-d00a-4f8e-a400-ec1d7a8c679f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:53.693816 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-792ca5b6-d00a-4f8e-a400-ec1d7a8c679f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:53.700503 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-792ca5b6-d00a-4f8e-a400-ec1d7a8c679f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:53.700949 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-792ca5b6-d00a-4f8e-a400-ec1d7a8c679f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:53.701724 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-792ca5b6-d00a-4f8e-a400-ec1d7a8c679f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:53.702392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-792ca5b6-d00a-4f8e-a400-ec1d7a8c679f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:53.888435 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-792ca5b6-d00a-4f8e-a400-ec1d7a8c679f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:53.898897 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-792ca5b6-d00a-4f8e-a400-ec1d7a8c679f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:53.900633 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-792ca5b6-d00a-4f8e-a400-ec1d7a8c679f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:53.902047 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-792ca5b6-d00a-4f8e-a400-ec1d7a8c679f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.214364 Dec 15 11:32:53.902938 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 203/401] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:53 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:54.288217 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7e869216-36ac-4943-b176-ead288088df7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:54.289669 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7e869216-36ac-4943-b176-ead288088df7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:54.300025 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e869216-36ac-4943-b176-ead288088df7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:54.300856 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e869216-36ac-4943-b176-ead288088df7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:54.302696 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e869216-36ac-4943-b176-ead288088df7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:54.304165 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e869216-36ac-4943-b176-ead288088df7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:54.608191 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7e869216-36ac-4943-b176-ead288088df7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:54.615995 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7e869216-36ac-4943-b176-ead288088df7 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.336262 Dec 15 11:32:54.617261 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 199/402] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:54 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:54.923460 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8124c9fe-fa87-4222-aae8-89702bf8bc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:54.924936 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8124c9fe-fa87-4222-aae8-89702bf8bc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:54.939030 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8124c9fe-fa87-4222-aae8-89702bf8bc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:54.939449 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8124c9fe-fa87-4222-aae8-89702bf8bc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:54.940483 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8124c9fe-fa87-4222-aae8-89702bf8bc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:54.940913 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8124c9fe-fa87-4222-aae8-89702bf8bc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:55.201593 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8124c9fe-fa87-4222-aae8-89702bf8bc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:55.227599 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8124c9fe-fa87-4222-aae8-89702bf8bc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:55.229408 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8124c9fe-fa87-4222-aae8-89702bf8bc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:55.233356 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8124c9fe-fa87-4222-aae8-89702bf8bc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.313372 Dec 15 11:32:55.245315 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 204/403] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:54 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:55.639856 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-cc3e4365-5cba-4346-8741-9a32e36be8a6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:55.641244 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-cc3e4365-5cba-4346-8741-9a32e36be8a6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:55.650066 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cc3e4365-5cba-4346-8741-9a32e36be8a6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:55.650976 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cc3e4365-5cba-4346-8741-9a32e36be8a6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:55.652174 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cc3e4365-5cba-4346-8741-9a32e36be8a6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:55.653300 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cc3e4365-5cba-4346-8741-9a32e36be8a6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:55.923558 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-cc3e4365-5cba-4346-8741-9a32e36be8a6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:55.932228 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-cc3e4365-5cba-4346-8741-9a32e36be8a6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.296403 Dec 15 11:32:55.932890 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 200/404] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:55 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:56.251789 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9f7afe6c-df30-4a4e-9c5e-6aa0eb489516 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:56.253231 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9f7afe6c-df30-4a4e-9c5e-6aa0eb489516 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:56.274863 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f7afe6c-df30-4a4e-9c5e-6aa0eb489516 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:56.275573 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f7afe6c-df30-4a4e-9c5e-6aa0eb489516 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:56.276642 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f7afe6c-df30-4a4e-9c5e-6aa0eb489516 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:56.277280 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f7afe6c-df30-4a4e-9c5e-6aa0eb489516 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:56.498921 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9f7afe6c-df30-4a4e-9c5e-6aa0eb489516 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:56.523320 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9f7afe6c-df30-4a4e-9c5e-6aa0eb489516 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:56.525375 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9f7afe6c-df30-4a4e-9c5e-6aa0eb489516 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:56.530137 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9f7afe6c-df30-4a4e-9c5e-6aa0eb489516 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.282208 Dec 15 11:32:56.534103 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 205/405] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:56 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:56.949014 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-cd617aae-ed75-457f-bb6d-530a08b4299c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:56.950398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-cd617aae-ed75-457f-bb6d-530a08b4299c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:56.972141 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd617aae-ed75-457f-bb6d-530a08b4299c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:56.973022 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd617aae-ed75-457f-bb6d-530a08b4299c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:56.975932 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd617aae-ed75-457f-bb6d-530a08b4299c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:56.976549 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cd617aae-ed75-457f-bb6d-530a08b4299c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:57.295901 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-cd617aae-ed75-457f-bb6d-530a08b4299c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:57.305441 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-cd617aae-ed75-457f-bb6d-530a08b4299c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.359804 Dec 15 11:32:57.312543 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 201/406] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:56 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:57.552997 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8c716ab9-e3f7-4861-b7f1-b639d6c3c625 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:57.553591 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8c716ab9-e3f7-4861-b7f1-b639d6c3c625 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:57.568574 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8c716ab9-e3f7-4861-b7f1-b639d6c3c625 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:57.569304 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8c716ab9-e3f7-4861-b7f1-b639d6c3c625 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:57.570288 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8c716ab9-e3f7-4861-b7f1-b639d6c3c625 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:57.570928 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8c716ab9-e3f7-4861-b7f1-b639d6c3c625 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:57.886604 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8c716ab9-e3f7-4861-b7f1-b639d6c3c625 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:57.895528 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8c716ab9-e3f7-4861-b7f1-b639d6c3c625 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:57.897071 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8c716ab9-e3f7-4861-b7f1-b639d6c3c625 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:57.898274 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8c716ab9-e3f7-4861-b7f1-b639d6c3c625 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.348990 Dec 15 11:32:57.918036 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 206/407] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:57 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:58.329060 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-22358e28-94d1-4eac-924f-d8140529e716 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:58.330245 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-22358e28-94d1-4eac-924f-d8140529e716 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:58.340239 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22358e28-94d1-4eac-924f-d8140529e716 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:58.348213 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22358e28-94d1-4eac-924f-d8140529e716 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:58.349374 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22358e28-94d1-4eac-924f-d8140529e716 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:58.349973 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-22358e28-94d1-4eac-924f-d8140529e716 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:58.727822 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-22358e28-94d1-4eac-924f-d8140529e716 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:58.736783 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-22358e28-94d1-4eac-924f-d8140529e716 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.411498 Dec 15 11:32:58.741880 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 202/408] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:58 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:32:58.926825 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2d9b99db-1838-4420-afb1-6c487e6c77d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:58.928242 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2d9b99db-1838-4420-afb1-6c487e6c77d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:58.943683 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d9b99db-1838-4420-afb1-6c487e6c77d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:58.947070 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d9b99db-1838-4420-afb1-6c487e6c77d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:58.952839 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d9b99db-1838-4420-afb1-6c487e6c77d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:58.953513 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d9b99db-1838-4420-afb1-6c487e6c77d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:59.269117 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2d9b99db-1838-4420-afb1-6c487e6c77d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:59.280082 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2d9b99db-1838-4420-afb1-6c487e6c77d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:59.287973 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2d9b99db-1838-4420-afb1-6c487e6c77d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:32:59.289613 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2d9b99db-1838-4420-afb1-6c487e6c77d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.368109 Dec 15 11:32:59.301575 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 207/409] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:32:58 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:32:59.757565 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7cae2698-f662-40f9-9f9e-f3c857eaa2b6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:32:59.758262 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7cae2698-f662-40f9-9f9e-f3c857eaa2b6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:32:59.765717 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cae2698-f662-40f9-9f9e-f3c857eaa2b6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:59.767496 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cae2698-f662-40f9-9f9e-f3c857eaa2b6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:32:59.768580 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cae2698-f662-40f9-9f9e-f3c857eaa2b6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:32:59.769248 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cae2698-f662-40f9-9f9e-f3c857eaa2b6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:00.124054 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7cae2698-f662-40f9-9f9e-f3c857eaa2b6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:00.133017 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7cae2698-f662-40f9-9f9e-f3c857eaa2b6 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.379019 Dec 15 11:33:00.145994 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 203/410] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:32:59 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:00.308450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5b92096b-83a9-4b53-94b3-a1149c1480e7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:00.309792 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5b92096b-83a9-4b53-94b3-a1149c1480e7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:00.317528 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5b92096b-83a9-4b53-94b3-a1149c1480e7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:00.336804 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5b92096b-83a9-4b53-94b3-a1149c1480e7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:00.343098 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5b92096b-83a9-4b53-94b3-a1149c1480e7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:00.343549 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5b92096b-83a9-4b53-94b3-a1149c1480e7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:00.674890 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5b92096b-83a9-4b53-94b3-a1149c1480e7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:00.685493 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5b92096b-83a9-4b53-94b3-a1149c1480e7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:00.687057 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5b92096b-83a9-4b53-94b3-a1149c1480e7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:00.688882 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5b92096b-83a9-4b53-94b3-a1149c1480e7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.383872 Dec 15 11:33:00.710558 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 208/411] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:00 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:01.154077 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f5393c81-7a35-4dc5-a21c-f000e0205832 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:01.155021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f5393c81-7a35-4dc5-a21c-f000e0205832 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:01.161944 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f5393c81-7a35-4dc5-a21c-f000e0205832 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:01.162395 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f5393c81-7a35-4dc5-a21c-f000e0205832 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:01.163225 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f5393c81-7a35-4dc5-a21c-f000e0205832 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:01.163843 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f5393c81-7a35-4dc5-a21c-f000e0205832 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:01.434210 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f5393c81-7a35-4dc5-a21c-f000e0205832 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:01.443264 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f5393c81-7a35-4dc5-a21c-f000e0205832 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.292995 Dec 15 11:33:01.451493 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 204/412] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:01 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:01.711050 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6879d21d-eb1d-44aa-bd83-a6501adbe855 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:01.712463 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6879d21d-eb1d-44aa-bd83-a6501adbe855 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:01.738170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6879d21d-eb1d-44aa-bd83-a6501adbe855 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:01.739060 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6879d21d-eb1d-44aa-bd83-a6501adbe855 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:01.740222 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6879d21d-eb1d-44aa-bd83-a6501adbe855 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:01.740911 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6879d21d-eb1d-44aa-bd83-a6501adbe855 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:02.007115 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6879d21d-eb1d-44aa-bd83-a6501adbe855 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:02.018881 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6879d21d-eb1d-44aa-bd83-a6501adbe855 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:02.020874 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6879d21d-eb1d-44aa-bd83-a6501adbe855 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:02.022631 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6879d21d-eb1d-44aa-bd83-a6501adbe855 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.316541 Dec 15 11:33:02.023770 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 209/413] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:01 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:33:02.460966 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-69f2f3ba-5a92-4c7c-aacc-ccf7dfafa521 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:02.461555 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-69f2f3ba-5a92-4c7c-aacc-ccf7dfafa521 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:02.468345 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69f2f3ba-5a92-4c7c-aacc-ccf7dfafa521 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:02.468796 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69f2f3ba-5a92-4c7c-aacc-ccf7dfafa521 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:02.469603 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69f2f3ba-5a92-4c7c-aacc-ccf7dfafa521 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:02.470743 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69f2f3ba-5a92-4c7c-aacc-ccf7dfafa521 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:02.710404 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-69f2f3ba-5a92-4c7c-aacc-ccf7dfafa521 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:02.719020 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-69f2f3ba-5a92-4c7c-aacc-ccf7dfafa521 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.261560 Dec 15 11:33:02.740040 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 205/414] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:02 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:03.041363 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d4f3b09a-07f9-49dd-a68c-ac9fbf99ecb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:03.049266 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d4f3b09a-07f9-49dd-a68c-ac9fbf99ecb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:03.063204 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4f3b09a-07f9-49dd-a68c-ac9fbf99ecb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:03.064791 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4f3b09a-07f9-49dd-a68c-ac9fbf99ecb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:03.075679 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4f3b09a-07f9-49dd-a68c-ac9fbf99ecb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:03.080492 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4f3b09a-07f9-49dd-a68c-ac9fbf99ecb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:03.308382 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d4f3b09a-07f9-49dd-a68c-ac9fbf99ecb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:03.320727 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d4f3b09a-07f9-49dd-a68c-ac9fbf99ecb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:03.322227 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d4f3b09a-07f9-49dd-a68c-ac9fbf99ecb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:03.323435 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d4f3b09a-07f9-49dd-a68c-ac9fbf99ecb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.285848 Dec 15 11:33:03.323990 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 210/415] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:03 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:03.745201 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f9ba2bb2-a303-44ce-b041-8d3a89e1fd6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:03.745791 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f9ba2bb2-a303-44ce-b041-8d3a89e1fd6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:03.752750 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f9ba2bb2-a303-44ce-b041-8d3a89e1fd6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:03.753462 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f9ba2bb2-a303-44ce-b041-8d3a89e1fd6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:03.754445 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f9ba2bb2-a303-44ce-b041-8d3a89e1fd6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:03.755056 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f9ba2bb2-a303-44ce-b041-8d3a89e1fd6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:04.010065 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f9ba2bb2-a303-44ce-b041-8d3a89e1fd6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:04.017688 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f9ba2bb2-a303-44ce-b041-8d3a89e1fd6f tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.276267 Dec 15 11:33:04.020669 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 206/416] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:03 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:04.341894 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b2d21308-df6c-4cbb-a4f6-70fc97b1d480 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:04.343164 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b2d21308-df6c-4cbb-a4f6-70fc97b1d480 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:04.356007 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b2d21308-df6c-4cbb-a4f6-70fc97b1d480 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:04.356738 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b2d21308-df6c-4cbb-a4f6-70fc97b1d480 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:04.357706 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b2d21308-df6c-4cbb-a4f6-70fc97b1d480 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:04.358287 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b2d21308-df6c-4cbb-a4f6-70fc97b1d480 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:04.576919 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b2d21308-df6c-4cbb-a4f6-70fc97b1d480 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:04.597437 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b2d21308-df6c-4cbb-a4f6-70fc97b1d480 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:04.600569 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b2d21308-df6c-4cbb-a4f6-70fc97b1d480 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:04.602488 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b2d21308-df6c-4cbb-a4f6-70fc97b1d480 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.264639 Dec 15 11:33:04.603620 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 211/417] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:04 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:05.040934 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-83baf79a-535b-4dc3-9b87-f234bf1310c9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:05.041770 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-83baf79a-535b-4dc3-9b87-f234bf1310c9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:05.065768 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-83baf79a-535b-4dc3-9b87-f234bf1310c9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:05.066892 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-83baf79a-535b-4dc3-9b87-f234bf1310c9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:05.068205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-83baf79a-535b-4dc3-9b87-f234bf1310c9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:05.069118 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-83baf79a-535b-4dc3-9b87-f234bf1310c9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:05.246706 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-83baf79a-535b-4dc3-9b87-f234bf1310c9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:05.254791 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-83baf79a-535b-4dc3-9b87-f234bf1310c9 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.220395 Dec 15 11:33:05.266338 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 207/418] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:05 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:05.621087 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a9348348-5113-4d1b-9883-b6a73e58249f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:05.623048 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a9348348-5113-4d1b-9883-b6a73e58249f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:05.631709 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a9348348-5113-4d1b-9883-b6a73e58249f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:05.632458 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a9348348-5113-4d1b-9883-b6a73e58249f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:05.634804 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a9348348-5113-4d1b-9883-b6a73e58249f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:05.635452 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a9348348-5113-4d1b-9883-b6a73e58249f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:05.828896 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a9348348-5113-4d1b-9883-b6a73e58249f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:05.847833 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a9348348-5113-4d1b-9883-b6a73e58249f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:05.849450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a9348348-5113-4d1b-9883-b6a73e58249f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:05.850741 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a9348348-5113-4d1b-9883-b6a73e58249f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.233197 Dec 15 11:33:05.851826 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 212/419] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:05 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:06.277241 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-da850808-fce4-4a39-be21-31bdb8b20297 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:06.284775 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-da850808-fce4-4a39-be21-31bdb8b20297 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:06.299815 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-da850808-fce4-4a39-be21-31bdb8b20297 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:06.300819 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-da850808-fce4-4a39-be21-31bdb8b20297 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:06.302244 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-da850808-fce4-4a39-be21-31bdb8b20297 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:06.303217 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-da850808-fce4-4a39-be21-31bdb8b20297 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:06.559024 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-da850808-fce4-4a39-be21-31bdb8b20297 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:06.575688 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-da850808-fce4-4a39-be21-31bdb8b20297 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 200 len: 1507 microversion: 2.1 time: 0.303137 Dec 15 11:33:06.576730 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 208/420] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:06 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:06.871498 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5a2562a9-ba33-4f26-82f2-0cf6ae0ea239 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:06.873674 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5a2562a9-ba33-4f26-82f2-0cf6ae0ea239 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:06.884286 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5a2562a9-ba33-4f26-82f2-0cf6ae0ea239 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:06.885401 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5a2562a9-ba33-4f26-82f2-0cf6ae0ea239 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:06.886944 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5a2562a9-ba33-4f26-82f2-0cf6ae0ea239 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:06.887878 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5a2562a9-ba33-4f26-82f2-0cf6ae0ea239 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:06.968118 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-decb9c46-0738-439d-a0ec-daaf03165f14 req-9a997a36-df5c-46d5-b9a3-4e934a2bc50c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfa4caf-d553-47fb-8527-1eaac916a973", "name": "network-vif-deleted", "tag": "5b92eb94-c983-4462-ad97-090ce3b4fc15"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:06.969691 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:33:06.969691 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:33:06.976951 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-decb9c46-0738-439d-a0ec-daaf03165f14 req-9a997a36-df5c-46d5-b9a3-4e934a2bc50c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:06.977484 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-decb9c46-0738-439d-a0ec-daaf03165f14 req-9a997a36-df5c-46d5-b9a3-4e934a2bc50c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:06.990117 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-decb9c46-0738-439d-a0ec-daaf03165f14 req-9a997a36-df5c-46d5-b9a3-4e934a2bc50c service nova] Creating event network-vif-deleted:5b92eb94-c983-4462-ad97-090ce3b4fc15 for instance 3bfa4caf-d553-47fb-8527-1eaac916a973 on hv-cinder-81321 Dec 15 11:33:06.995582 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-decb9c46-0738-439d-a0ec-daaf03165f14 req-9a997a36-df5c-46d5-b9a3-4e934a2bc50c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031040 Dec 15 11:33:06.996422 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 209/421] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:33:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:33:07.071188 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5a2562a9-ba33-4f26-82f2-0cf6ae0ea239 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:07.081180 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5a2562a9-ba33-4f26-82f2-0cf6ae0ea239 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:07.082836 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5a2562a9-ba33-4f26-82f2-0cf6ae0ea239 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:07.084228 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5a2562a9-ba33-4f26-82f2-0cf6ae0ea239 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.218699 Dec 15 11:33:07.085181 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 213/422] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:06 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:07.596771 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-486596f0-4312-450c-ad2d-96d533e8c630 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:07.597372 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-486596f0-4312-450c-ad2d-96d533e8c630 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 3bfa4caf-d553-47fb-8527-1eaac916a973] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:07.603584 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-486596f0-4312-450c-ad2d-96d533e8c630 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:07.604032 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-486596f0-4312-450c-ad2d-96d533e8c630 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:07.604815 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-486596f0-4312-450c-ad2d-96d533e8c630 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:07.605428 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-486596f0-4312-450c-ad2d-96d533e8c630 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:07.621262 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-486596f0-4312-450c-ad2d-96d533e8c630 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] HTTP exception thrown: Instance 3bfa4caf-d553-47fb-8527-1eaac916a973 could not be found. Dec 15 11:33:07.621850 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-486596f0-4312-450c-ad2d-96d533e8c630 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Returning 404 to user: Instance 3bfa4caf-d553-47fb-8527-1eaac916a973 could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:33:07.622706 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-486596f0-4312-450c-ad2d-96d533e8c630 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973" status: 404 len: 111 microversion: 2.1 time: 0.031106 Dec 15 11:33:07.627499 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 210/423] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:07 2021] GET /compute/v2.1/servers/3bfa4caf-d553-47fb-8527-1eaac916a973 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:33:07.631310 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-558a58c4-0858-43b3-819e-a3322136fa48 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:07.631813 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-558a58c4-0858-43b3-819e-a3322136fa48 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:07.639391 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-558a58c4-0858-43b3-819e-a3322136fa48 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:07.642143 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-558a58c4-0858-43b3-819e-a3322136fa48 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:07.643271 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-558a58c4-0858-43b3-819e-a3322136fa48 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:07.643976 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-558a58c4-0858-43b3-819e-a3322136fa48 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:07.669396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-558a58c4-0858-43b3-819e-a3322136fa48 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:33:07.754164 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-558a58c4-0858-43b3-819e-a3322136fa48 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 204 len: 0 microversion: 2.1 time: 0.126199 Dec 15 11:33:07.754962 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 214/424] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:33:07 2021] DELETE /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 11:33:07.763250 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-78c67843-0274-4fda-a7c2-2bd8a9f88a7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:07.764135 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-78c67843-0274-4fda-a7c2-2bd8a9f88a7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:07.771312 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78c67843-0274-4fda-a7c2-2bd8a9f88a7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:07.771987 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78c67843-0274-4fda-a7c2-2bd8a9f88a7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:07.772774 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78c67843-0274-4fda-a7c2-2bd8a9f88a7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:07.773209 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78c67843-0274-4fda-a7c2-2bd8a9f88a7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:07.921015 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-78c67843-0274-4fda-a7c2-2bd8a9f88a7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:07.932660 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-78c67843-0274-4fda-a7c2-2bd8a9f88a7c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.173470 Dec 15 11:33:07.933524 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 211/425] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:07 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:08.104108 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0f54f97d-f9aa-4a58-b8c2-3029f8094a7e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:08.104979 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0f54f97d-f9aa-4a58-b8c2-3029f8094a7e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:08.111881 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f54f97d-f9aa-4a58-b8c2-3029f8094a7e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:08.112333 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f54f97d-f9aa-4a58-b8c2-3029f8094a7e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:08.113130 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f54f97d-f9aa-4a58-b8c2-3029f8094a7e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:08.113562 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f54f97d-f9aa-4a58-b8c2-3029f8094a7e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:08.259677 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0f54f97d-f9aa-4a58-b8c2-3029f8094a7e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:08.272538 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0f54f97d-f9aa-4a58-b8c2-3029f8094a7e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:08.276993 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0f54f97d-f9aa-4a58-b8c2-3029f8094a7e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:08.278251 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0f54f97d-f9aa-4a58-b8c2-3029f8094a7e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.178245 Dec 15 11:33:08.278855 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 215/426] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:08 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:08.949971 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-091bf5a3-1d66-427b-a643-d7dbbb0b1679 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:08.951337 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-091bf5a3-1d66-427b-a643-d7dbbb0b1679 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:08.958111 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-091bf5a3-1d66-427b-a643-d7dbbb0b1679 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:08.959047 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-091bf5a3-1d66-427b-a643-d7dbbb0b1679 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:08.960109 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-091bf5a3-1d66-427b-a643-d7dbbb0b1679 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:08.960636 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-091bf5a3-1d66-427b-a643-d7dbbb0b1679 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:09.102801 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-091bf5a3-1d66-427b-a643-d7dbbb0b1679 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:09.110293 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-091bf5a3-1d66-427b-a643-d7dbbb0b1679 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.164507 Dec 15 11:33:09.111638 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 212/427] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:08 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:33:09.297730 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-25e9c6c6-6198-4af3-b3e7-6d349735d3a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:09.301799 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-25e9c6c6-6198-4af3-b3e7-6d349735d3a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:09.308831 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-25e9c6c6-6198-4af3-b3e7-6d349735d3a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:09.309284 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-25e9c6c6-6198-4af3-b3e7-6d349735d3a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:09.310067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-25e9c6c6-6198-4af3-b3e7-6d349735d3a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:09.310723 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-25e9c6c6-6198-4af3-b3e7-6d349735d3a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:09.653639 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-25e9c6c6-6198-4af3-b3e7-6d349735d3a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:09.663758 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-25e9c6c6-6198-4af3-b3e7-6d349735d3a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:09.666080 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-25e9c6c6-6198-4af3-b3e7-6d349735d3a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:09.667276 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-25e9c6c6-6198-4af3-b3e7-6d349735d3a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.373219 Dec 15 11:33:09.667828 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 216/428] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:09 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:10.127570 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fa550789-8ace-4a24-a0c2-80b23b3fbb37 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:10.128175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fa550789-8ace-4a24-a0c2-80b23b3fbb37 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:10.134396 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fa550789-8ace-4a24-a0c2-80b23b3fbb37 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:10.134874 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fa550789-8ace-4a24-a0c2-80b23b3fbb37 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:10.135649 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fa550789-8ace-4a24-a0c2-80b23b3fbb37 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:10.136112 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fa550789-8ace-4a24-a0c2-80b23b3fbb37 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:10.305090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fa550789-8ace-4a24-a0c2-80b23b3fbb37 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:10.313431 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fa550789-8ace-4a24-a0c2-80b23b3fbb37 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.189360 Dec 15 11:33:10.314780 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 213/429] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:10 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:10.686523 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5822855c-74b1-47fe-8453-a67da8db2393 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:10.687160 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5822855c-74b1-47fe-8453-a67da8db2393 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:10.694200 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5822855c-74b1-47fe-8453-a67da8db2393 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:10.694676 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5822855c-74b1-47fe-8453-a67da8db2393 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:10.695458 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5822855c-74b1-47fe-8453-a67da8db2393 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:10.695882 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5822855c-74b1-47fe-8453-a67da8db2393 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:10.854256 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5822855c-74b1-47fe-8453-a67da8db2393 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:10.864102 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5822855c-74b1-47fe-8453-a67da8db2393 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:10.865609 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5822855c-74b1-47fe-8453-a67da8db2393 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:10.881693 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5822855c-74b1-47fe-8453-a67da8db2393 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.184029 Dec 15 11:33:10.881693 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 217/430] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:10 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:11.331594 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-9de70b29-4a1b-4abf-8c7f-8196d4bda72c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:11.332214 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-9de70b29-4a1b-4abf-8c7f-8196d4bda72c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:11.338220 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9de70b29-4a1b-4abf-8c7f-8196d4bda72c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:11.338940 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9de70b29-4a1b-4abf-8c7f-8196d4bda72c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:11.339713 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9de70b29-4a1b-4abf-8c7f-8196d4bda72c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:11.340146 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9de70b29-4a1b-4abf-8c7f-8196d4bda72c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:11.481087 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9de70b29-4a1b-4abf-8c7f-8196d4bda72c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:11.489200 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-9de70b29-4a1b-4abf-8c7f-8196d4bda72c tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.161236 Dec 15 11:33:11.496333 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 214/431] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:11 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:11.773454 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a54d47c6-7754-4bde-af9b-c9d91c631120 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Action: 'create', calling method: .version_select at 0x7fdf59987550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1810229286"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:11.787803 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-a54d47c6-7754-4bde-af9b-c9d91c631120 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Getting quotas for project 9b901444a8394be1ba87483d8001829f. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:33:11.791471 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-a54d47c6-7754-4bde-af9b-c9d91c631120 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Getting quotas for user 3878c28136e64ab6a54f5030913b867a and project 9b901444a8394be1ba87483d8001829f. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:33:11.802588 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a54d47c6-7754-4bde-af9b-c9d91c631120 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [958d486b-2a2b-458a-b8db-349e4b60dbdd] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 11:33:11.884974 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-01ed9f90-599f-46c9-88ef-e0e92065cc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:11.885584 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-01ed9f90-599f-46c9-88ef-e0e92065cc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:11.891976 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-01ed9f90-599f-46c9-88ef-e0e92065cc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:11.892920 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-01ed9f90-599f-46c9-88ef-e0e92065cc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:11.893696 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-01ed9f90-599f-46c9-88ef-e0e92065cc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:11.894125 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-01ed9f90-599f-46c9-88ef-e0e92065cc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:12.026670 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-01ed9f90-599f-46c9-88ef-e0e92065cc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:12.035922 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-01ed9f90-599f-46c9-88ef-e0e92065cc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:12.037392 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-01ed9f90-599f-46c9-88ef-e0e92065cc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:12.038537 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-01ed9f90-599f-46c9-88ef-e0e92065cc80 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.157301 Dec 15 11:33:12.039102 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 215/432] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:11 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:33:12.506676 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-20f1d0dd-1779-4407-a174-f5412cc07315 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:12.507301 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-20f1d0dd-1779-4407-a174-f5412cc07315 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:12.513715 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-20f1d0dd-1779-4407-a174-f5412cc07315 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:12.514157 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-20f1d0dd-1779-4407-a174-f5412cc07315 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:12.514962 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-20f1d0dd-1779-4407-a174-f5412cc07315 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:12.515395 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-20f1d0dd-1779-4407-a174-f5412cc07315 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:12.565243 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:33:12.565493 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.18) !!! Dec 15 11:33:12.642404 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-20f1d0dd-1779-4407-a174-f5412cc07315 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:12.649569 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-20f1d0dd-1779-4407-a174-f5412cc07315 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.146520 Dec 15 11:33:12.650126 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 216/433] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:12 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:33:12.822527 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [None req-a54d47c6-7754-4bde-af9b-c9d91c631120 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [958d486b-2a2b-458a-b8db-349e4b60dbdd] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49830. Dec 15 11:33:12.823820 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3ec7f20a-7fb4-47e1-85e1-143ca7c9a63d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:12.824329 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3ec7f20a-7fb4-47e1-85e1-143ca7c9a63d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:12.830518 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3ec7f20a-7fb4-47e1-85e1-143ca7c9a63d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:12.831074 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3ec7f20a-7fb4-47e1-85e1-143ca7c9a63d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:12.832303 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3ec7f20a-7fb4-47e1-85e1-143ca7c9a63d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:12.833077 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3ec7f20a-7fb4-47e1-85e1-143ca7c9a63d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:12.950481 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-a54d47c6-7754-4bde-af9b-c9d91c631120 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Getting quotas for project 9b901444a8394be1ba87483d8001829f. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:33:12.955411 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-a54d47c6-7754-4bde-af9b-c9d91c631120 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Getting quotas for user 3878c28136e64ab6a54f5030913b867a and project 9b901444a8394be1ba87483d8001829f. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:33:12.963425 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-3ec7f20a-7fb4-47e1-85e1-143ca7c9a63d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lazy-loading 'services' on Instance uuid 23ab2164-7f19-4c54-8e4e-91295c45a538 {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:33:12.969480 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a54d47c6-7754-4bde-af9b-c9d91c631120 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 1.199544 Dec 15 11:33:12.977334 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 218/434] 10.222.0.18 () {60 vars in 1157 bytes} [Wed Dec 15 11:33:11 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:13.024921 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-103931644", "imageRef": "d55c53bb-3298-4570-8227-3ec72b2be782", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1810229286", "networks": [{"uuid": "bd089be1-53a7-4d20-bbe1-bc09d5e0dea3"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:13.084251 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] validate_networks() for [('bd089be1-53a7-4d20-bbe1-bc09d5e0dea3', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:33:13.088781 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3ec7f20a-7fb4-47e1-85e1-143ca7c9a63d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/os-volume_attachments/77e130bc-1e57-4d5a-8cd4-644fe38e943f" status: 202 len: 0 microversion: 2.1 time: 0.268694 Dec 15 11:33:13.089724 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 217/435] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:33:12 2021] DELETE /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/os-volume_attachments/77e130bc-1e57-4d5a-8cd4-644fe38e943f => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:33:13.096547 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-16c507bc-073a-473b-a877-b35db040cb4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:13.097341 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-16c507bc-073a-473b-a877-b35db040cb4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:13.105014 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-16c507bc-073a-473b-a877-b35db040cb4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:13.105455 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-16c507bc-073a-473b-a877-b35db040cb4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:13.107020 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-16c507bc-073a-473b-a877-b35db040cb4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:13.107855 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-16c507bc-073a-473b-a877-b35db040cb4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:13.267670 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-16c507bc-073a-473b-a877-b35db040cb4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:13.276744 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-16c507bc-073a-473b-a877-b35db040cb4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:13.278326 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-16c507bc-073a-473b-a877-b35db040cb4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:13.279719 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-16c507bc-073a-473b-a877-b35db040cb4e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.188544 Dec 15 11:33:13.280583 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 218/436] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:13 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:13.506492 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:33:13.506945 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:33:13.507420 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:33:13.507828 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:33:13.508350 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:33:13.517011 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:13.518196 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:13.519232 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:13.519674 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:13.538595 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Getting quotas for project 9b901444a8394be1ba87483d8001829f. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:33:13.544115 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Getting quotas for user 3878c28136e64ab6a54f5030913b867a and project 9b901444a8394be1ba87483d8001829f. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:33:13.559844 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:33:13.562775 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d55c53bb-3298-4570-8227-3ec72b2be782',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:33:13.619750 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d62c11ce-9cc8-4a4d-9831-4b8022164d7b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600168 Dec 15 11:33:13.620612 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 219/437] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:33:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 11:33:13.631582 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-cbdc49fa-ee62-4522-9167-bf9924a55316 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:13.632851 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-cbdc49fa-ee62-4522-9167-bf9924a55316 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:13.665952 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3703bafb-6b59-4d69-bc15-c1be8e72ad79 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:13.666676 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3703bafb-6b59-4d69-bc15-c1be8e72ad79 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:13.673789 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3703bafb-6b59-4d69-bc15-c1be8e72ad79 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:13.674318 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3703bafb-6b59-4d69-bc15-c1be8e72ad79 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:13.675214 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3703bafb-6b59-4d69-bc15-c1be8e72ad79 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:13.676088 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3703bafb-6b59-4d69-bc15-c1be8e72ad79 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:13.707661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-cbdc49fa-ee62-4522-9167-bf9924a55316 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:13.714819 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-cbdc49fa-ee62-4522-9167-bf9924a55316 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1258 microversion: 2.1 time: 0.088127 Dec 15 11:33:13.719294 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 219/438] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:13 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:13.834145 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3703bafb-6b59-4d69-bc15-c1be8e72ad79 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49fd055cb064266bdc9de039de2f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38ce889f1a45c499576f66624cfacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:13.844702 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3703bafb-6b59-4d69-bc15-c1be8e72ad79 tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 200 len: 1519 microversion: 2.1 time: 0.182326 Dec 15 11:33:13.845543 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 220/439] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:13 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:13.931658 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-906ca0a7-09ad-4fa1-a4fd-6ce43bb92aa1 req-f8c85d6e-7ebc-40af-a4f5-83da3234375b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2f09d7-6122-484a-b99c-33d451ae87a9", "name": "network-vif-deleted", "tag": "6dc8d65b-bae1-4e78-9328-c8894e391e1f"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:13.933695 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:33:13.933695 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:33:13.942886 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-906ca0a7-09ad-4fa1-a4fd-6ce43bb92aa1 req-f8c85d6e-7ebc-40af-a4f5-83da3234375b service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:13.943418 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-906ca0a7-09ad-4fa1-a4fd-6ce43bb92aa1 req-f8c85d6e-7ebc-40af-a4f5-83da3234375b service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:13.955051 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-906ca0a7-09ad-4fa1-a4fd-6ce43bb92aa1 req-f8c85d6e-7ebc-40af-a4f5-83da3234375b service nova] Creating event network-vif-deleted:6dc8d65b-bae1-4e78-9328-c8894e391e1f for instance 9c2f09d7-6122-484a-b99c-33d451ae87a9 on hv-cinder-81321 Dec 15 11:33:13.959723 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-906ca0a7-09ad-4fa1-a4fd-6ce43bb92aa1 req-f8c85d6e-7ebc-40af-a4f5-83da3234375b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031618 Dec 15 11:33:13.960308 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 220/440] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:33:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:14.208754 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c4d2d36d-0da8-4bc8-8a32-40f3dc0439a3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:14.214927 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c4d2d36d-0da8-4bc8-8a32-40f3dc0439a3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:14.215366 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c4d2d36d-0da8-4bc8-8a32-40f3dc0439a3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:14.238190 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c4d2d36d-0da8-4bc8-8a32-40f3dc0439a3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Going to try to stop instance {{(pid=116083) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 11:33:14.279185 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c4d2d36d-0da8-4bc8-8a32-40f3dc0439a3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 202 len: 0 microversion: 2.1 time: 0.073960 Dec 15 11:33:14.279830 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 221/441] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:33:14 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:33:14.288934 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c31b97db-b32e-44bd-9324-294c0bb714fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:14.289640 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c31b97db-b32e-44bd-9324-294c0bb714fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:14.296116 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c31b97db-b32e-44bd-9324-294c0bb714fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:14.296554 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c31b97db-b32e-44bd-9324-294c0bb714fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:14.297338 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c31b97db-b32e-44bd-9324-294c0bb714fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:14.297763 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c31b97db-b32e-44bd-9324-294c0bb714fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:14.300351 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2672d100-24ab-4a0b-8a38-2c39692b79b6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:14.302258 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2672d100-24ab-4a0b-8a38-2c39692b79b6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:14.311171 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2672d100-24ab-4a0b-8a38-2c39692b79b6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:14.311765 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2672d100-24ab-4a0b-8a38-2c39692b79b6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:14.313572 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2672d100-24ab-4a0b-8a38-2c39692b79b6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:14.314213 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2672d100-24ab-4a0b-8a38-2c39692b79b6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:14.458691 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c31b97db-b32e-44bd-9324-294c0bb714fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:14.466164 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c31b97db-b32e-44bd-9324-294c0bb714fa tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1675 microversion: 2.1 time: 0.181253 Dec 15 11:33:14.466766 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 221/442] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:14 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:14.475539 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2672d100-24ab-4a0b-8a38-2c39692b79b6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:14.484763 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2672d100-24ab-4a0b-8a38-2c39692b79b6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:14.486303 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2672d100-24ab-4a0b-8a38-2c39692b79b6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:14.487472 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2672d100-24ab-4a0b-8a38-2c39692b79b6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.192976 Dec 15 11:33:14.488028 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 222/443] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:14 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:33:14.731884 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e5e771af-f82f-4e22-9c99-653294de3ad7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:14.732493 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e5e771af-f82f-4e22-9c99-653294de3ad7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:14.784069 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e5e771af-f82f-4e22-9c99-653294de3ad7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:14.790821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e5e771af-f82f-4e22-9c99-653294de3ad7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1258 microversion: 2.1 time: 0.062513 Dec 15 11:33:14.791446 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 222/444] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:14 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1258 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:14.861139 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-23d9b247-3f26-4c2a-b874-a732a6ba91df tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:14.861783 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-23d9b247-3f26-4c2a-b874-a732a6ba91df tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] [instance: 9c2f09d7-6122-484a-b99c-33d451ae87a9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:14.868050 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23d9b247-3f26-4c2a-b874-a732a6ba91df tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:14.868491 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23d9b247-3f26-4c2a-b874-a732a6ba91df tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:14.869268 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23d9b247-3f26-4c2a-b874-a732a6ba91df tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:14.869699 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23d9b247-3f26-4c2a-b874-a732a6ba91df tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:14.883320 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-23d9b247-3f26-4c2a-b874-a732a6ba91df tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] HTTP exception thrown: Instance 9c2f09d7-6122-484a-b99c-33d451ae87a9 could not be found. Dec 15 11:33:14.884472 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-23d9b247-3f26-4c2a-b874-a732a6ba91df tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] Returning 404 to user: Instance 9c2f09d7-6122-484a-b99c-33d451ae87a9 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:33:14.884844 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-23d9b247-3f26-4c2a-b874-a732a6ba91df tempest-ServerRescueNegativeTestJSON-858080671 tempest-ServerRescueNegativeTestJSON-858080671-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9" status: 404 len: 111 microversion: 2.1 time: 0.027647 Dec 15 11:33:14.885589 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 223/445] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:14 2021] GET /compute/v2.1/servers/9c2f09d7-6122-484a-b99c-33d451ae87a9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:33:14.929517 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-df79e49b-ba61-4dfb-8ea9-8708e3fa1dcf req-915a0df8-2fd9-43a3-8d92-d28c697ee47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0866db17-45ec-4550-b834-8880e974be1d", "name": "network-vif-plugged", "status": "completed", "tag": "b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:14.931081 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:33:14.931081 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:33:14.949774 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-df79e49b-ba61-4dfb-8ea9-8708e3fa1dcf req-915a0df8-2fd9-43a3-8d92-d28c697ee47c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:14.950221 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-df79e49b-ba61-4dfb-8ea9-8708e3fa1dcf req-915a0df8-2fd9-43a3-8d92-d28c697ee47c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:14.965348 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-df79e49b-ba61-4dfb-8ea9-8708e3fa1dcf req-915a0df8-2fd9-43a3-8d92-d28c697ee47c service nova] Creating event network-vif-plugged:b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d for instance 0866db17-45ec-4550-b834-8880e974be1d on hv-cinder-81321 Dec 15 11:33:14.970639 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-df79e49b-ba61-4dfb-8ea9-8708e3fa1dcf req-915a0df8-2fd9-43a3-8d92-d28c697ee47c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045318 Dec 15 11:33:14.971852 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 223/446] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:33:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:15.483593 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c6e2b9ee-984b-4039-a64f-11b20f3689c4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:15.484276 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c6e2b9ee-984b-4039-a64f-11b20f3689c4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:15.490498 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6e2b9ee-984b-4039-a64f-11b20f3689c4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:15.491083 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6e2b9ee-984b-4039-a64f-11b20f3689c4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:15.491970 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6e2b9ee-984b-4039-a64f-11b20f3689c4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:15.492399 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6e2b9ee-984b-4039-a64f-11b20f3689c4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:15.506268 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-991a94c3-a86e-4c1c-9874-9302ef51f6d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:15.507289 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-991a94c3-a86e-4c1c-9874-9302ef51f6d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:15.513522 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-991a94c3-a86e-4c1c-9874-9302ef51f6d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:15.514078 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-991a94c3-a86e-4c1c-9874-9302ef51f6d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:15.515140 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-991a94c3-a86e-4c1c-9874-9302ef51f6d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:15.515765 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-991a94c3-a86e-4c1c-9874-9302ef51f6d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:15.637370 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c6e2b9ee-984b-4039-a64f-11b20f3689c4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:15.646858 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c6e2b9ee-984b-4039-a64f-11b20f3689c4 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1675 microversion: 2.1 time: 0.166859 Dec 15 11:33:15.647707 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 224/447] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:15 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:15.754827 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-991a94c3-a86e-4c1c-9874-9302ef51f6d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:15.763146 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-991a94c3-a86e-4c1c-9874-9302ef51f6d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:15.764617 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-991a94c3-a86e-4c1c-9874-9302ef51f6d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:15.765746 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-991a94c3-a86e-4c1c-9874-9302ef51f6d0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.264022 Dec 15 11:33:15.766301 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 224/448] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:15 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:15.807469 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cc6eadef-3594-4d50-b9a9-07d338fdc387 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:15.808175 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cc6eadef-3594-4d50-b9a9-07d338fdc387 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:15.815374 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cc6eadef-3594-4d50-b9a9-07d338fdc387 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:15.815844 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cc6eadef-3594-4d50-b9a9-07d338fdc387 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:15.816816 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cc6eadef-3594-4d50-b9a9-07d338fdc387 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:15.817267 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cc6eadef-3594-4d50-b9a9-07d338fdc387 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:15.880736 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cc6eadef-3594-4d50-b9a9-07d338fdc387 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:15.888311 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cc6eadef-3594-4d50-b9a9-07d338fdc387 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1318 microversion: 2.1 time: 0.084335 Dec 15 11:33:15.898135 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 225/449] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:15 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1318 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:16.665499 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f0666a00-383b-4d4c-9626-cd04dc719d59 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:16.666382 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f0666a00-383b-4d4c-9626-cd04dc719d59 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:16.675435 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f0666a00-383b-4d4c-9626-cd04dc719d59 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:16.675889 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f0666a00-383b-4d4c-9626-cd04dc719d59 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:16.676694 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f0666a00-383b-4d4c-9626-cd04dc719d59 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:16.678011 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f0666a00-383b-4d4c-9626-cd04dc719d59 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:16.784143 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-435d4c3e-20c5-4a2a-b32f-b980190ab2ad tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:16.784662 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-435d4c3e-20c5-4a2a-b32f-b980190ab2ad tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:16.790553 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-435d4c3e-20c5-4a2a-b32f-b980190ab2ad tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:16.791027 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-435d4c3e-20c5-4a2a-b32f-b980190ab2ad tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:16.791804 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-435d4c3e-20c5-4a2a-b32f-b980190ab2ad tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:16.792246 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-435d4c3e-20c5-4a2a-b32f-b980190ab2ad tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:16.959255 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-435d4c3e-20c5-4a2a-b32f-b980190ab2ad tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:16.969501 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-435d4c3e-20c5-4a2a-b32f-b980190ab2ad tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:16.971146 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-435d4c3e-20c5-4a2a-b32f-b980190ab2ad tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:16.972349 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-435d4c3e-20c5-4a2a-b32f-b980190ab2ad tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.191906 Dec 15 11:33:16.972996 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 226/450] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:16 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:33:16.978831 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-028cecb7-7250-41a4-ba04-7432503b089e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:16.979443 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-028cecb7-7250-41a4-ba04-7432503b089e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:16.985496 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-028cecb7-7250-41a4-ba04-7432503b089e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:16.986624 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-028cecb7-7250-41a4-ba04-7432503b089e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:16.987372 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-028cecb7-7250-41a4-ba04-7432503b089e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:16.987802 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-028cecb7-7250-41a4-ba04-7432503b089e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:17.058997 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-028cecb7-7250-41a4-ba04-7432503b089e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:17.068452 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-028cecb7-7250-41a4-ba04-7432503b089e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1316 microversion: 2.1 time: 0.094317 Dec 15 11:33:17.069296 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 227/451] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:16 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:17.160380 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f0666a00-383b-4d4c-9626-cd04dc719d59 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:17.170172 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f0666a00-383b-4d4c-9626-cd04dc719d59 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1675 microversion: 2.1 time: 0.509146 Dec 15 11:33:17.180926 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 225/452] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:16 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1675 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:17.991622 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-33182e0b-010a-46a3-b7c0-6b6a1e8d9430 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:17.993087 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-33182e0b-010a-46a3-b7c0-6b6a1e8d9430 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:18.000988 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-33182e0b-010a-46a3-b7c0-6b6a1e8d9430 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:18.002421 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-33182e0b-010a-46a3-b7c0-6b6a1e8d9430 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:18.003480 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-33182e0b-010a-46a3-b7c0-6b6a1e8d9430 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:18.004079 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-33182e0b-010a-46a3-b7c0-6b6a1e8d9430 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:18.089013 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ac67ae48-27dc-4d56-9889-9a34d015fc95 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:18.089894 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-ac67ae48-27dc-4d56-9889-9a34d015fc95 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:18.101377 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ac67ae48-27dc-4d56-9889-9a34d015fc95 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:18.116741 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ac67ae48-27dc-4d56-9889-9a34d015fc95 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:18.117680 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ac67ae48-27dc-4d56-9889-9a34d015fc95 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:18.118320 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ac67ae48-27dc-4d56-9889-9a34d015fc95 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:18.358064 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ac67ae48-27dc-4d56-9889-9a34d015fc95 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:18.376440 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ac67ae48-27dc-4d56-9889-9a34d015fc95 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.292795 Dec 15 11:33:18.388326 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 226/453] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:18 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:18.389005 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-33182e0b-010a-46a3-b7c0-6b6a1e8d9430 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:18.393667 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-25698451-1a0a-4305-8917-742af2722281 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:18.394688 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-25698451-1a0a-4305-8917-742af2722281 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:18.402231 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-33182e0b-010a-46a3-b7c0-6b6a1e8d9430 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:18.405352 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-33182e0b-010a-46a3-b7c0-6b6a1e8d9430 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:18.408276 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-33182e0b-010a-46a3-b7c0-6b6a1e8d9430 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.420840 Dec 15 11:33:18.409473 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 228/454] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:17 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:18.411006 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-25698451-1a0a-4305-8917-742af2722281 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:18.411653 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-25698451-1a0a-4305-8917-742af2722281 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:18.412618 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-25698451-1a0a-4305-8917-742af2722281 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:18.413049 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-25698451-1a0a-4305-8917-742af2722281 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:18.596701 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-25698451-1a0a-4305-8917-742af2722281 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:18.604596 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-25698451-1a0a-4305-8917-742af2722281 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1675 microversion: 2.1 time: 0.215062 Dec 15 11:33:18.614977 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 227/455] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:18 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1675 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:19.396659 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b5139fcd-5ba1-44ad-941a-a8863013c4e4 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:19.398710 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b5139fcd-5ba1-44ad-941a-a8863013c4e4 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:19.410748 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5139fcd-5ba1-44ad-941a-a8863013c4e4 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:19.411206 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5139fcd-5ba1-44ad-941a-a8863013c4e4 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:19.412012 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5139fcd-5ba1-44ad-941a-a8863013c4e4 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:19.412450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5139fcd-5ba1-44ad-941a-a8863013c4e4 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:19.428314 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7e6750d9-e549-4a91-a0df-d9be604675ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:19.431311 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7e6750d9-e549-4a91-a0df-d9be604675ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:19.438205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e6750d9-e549-4a91-a0df-d9be604675ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:19.438908 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e6750d9-e549-4a91-a0df-d9be604675ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:19.439893 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e6750d9-e549-4a91-a0df-d9be604675ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:19.440500 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e6750d9-e549-4a91-a0df-d9be604675ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:19.643043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b5139fcd-5ba1-44ad-941a-a8863013c4e4 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:19.658641 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b5139fcd-5ba1-44ad-941a-a8863013c4e4 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.266541 Dec 15 11:33:19.663926 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 229/456] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:19 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:19.679015 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f6bfc3e8-b79b-4843-a6da-e53a2ea0f254 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:19.679646 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f6bfc3e8-b79b-4843-a6da-e53a2ea0f254 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:19.698038 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6bfc3e8-b79b-4843-a6da-e53a2ea0f254 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:19.698484 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6bfc3e8-b79b-4843-a6da-e53a2ea0f254 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:19.699317 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6bfc3e8-b79b-4843-a6da-e53a2ea0f254 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:19.699760 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6bfc3e8-b79b-4843-a6da-e53a2ea0f254 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:19.743071 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7e6750d9-e549-4a91-a0df-d9be604675ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:19.759390 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7e6750d9-e549-4a91-a0df-d9be604675ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:19.761895 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7e6750d9-e549-4a91-a0df-d9be604675ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:19.763307 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7e6750d9-e549-4a91-a0df-d9be604675ac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.340111 Dec 15 11:33:19.764767 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 228/457] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:19 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:19.910230 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f6bfc3e8-b79b-4843-a6da-e53a2ea0f254 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:19.919257 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f6bfc3e8-b79b-4843-a6da-e53a2ea0f254 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1675 microversion: 2.1 time: 0.253434 Dec 15 11:33:19.919840 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 230/458] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:19 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1675 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:20.676604 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e80a7e1e-406d-4d5a-95d5-fdb6ef79adfd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:20.677256 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e80a7e1e-406d-4d5a-95d5-fdb6ef79adfd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:20.683451 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e80a7e1e-406d-4d5a-95d5-fdb6ef79adfd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:20.683899 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e80a7e1e-406d-4d5a-95d5-fdb6ef79adfd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:20.684683 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e80a7e1e-406d-4d5a-95d5-fdb6ef79adfd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:20.685112 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e80a7e1e-406d-4d5a-95d5-fdb6ef79adfd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:20.843039 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e80a7e1e-406d-4d5a-95d5-fdb6ef79adfd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:20.851014 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e80a7e1e-406d-4d5a-95d5-fdb6ef79adfd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.179016 Dec 15 11:33:20.857373 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 229/459] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:20 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:20.861873 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2e5e5b06-afdb-4ad6-8772-5b7333f8447f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:20.862695 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2e5e5b06-afdb-4ad6-8772-5b7333f8447f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:20.869598 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e5e5b06-afdb-4ad6-8772-5b7333f8447f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:20.870448 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e5e5b06-afdb-4ad6-8772-5b7333f8447f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:20.871553 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e5e5b06-afdb-4ad6-8772-5b7333f8447f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:20.872352 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e5e5b06-afdb-4ad6-8772-5b7333f8447f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:20.907398 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cb4d299e-113a-4964-99da-d5678fc7d6fb tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] Action: 'create', calling method: .version_select at 0x7fdf5999ea60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-833550460", "metadata": {"Type": "work"}}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:21.048139 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2e5e5b06-afdb-4ad6-8772-5b7333f8447f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:21.059496 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2e5e5b06-afdb-4ad6-8772-5b7333f8447f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:21.061117 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2e5e5b06-afdb-4ad6-8772-5b7333f8447f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:21.062333 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2e5e5b06-afdb-4ad6-8772-5b7333f8447f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.209489 Dec 15 11:33:21.062958 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 230/460] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:20 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:21.068698 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ab4cf7ae-985e-4d71-b976-cea25ea8a9ac tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:21.069307 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-ab4cf7ae-985e-4d71-b976-cea25ea8a9ac tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:21.077471 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ab4cf7ae-985e-4d71-b976-cea25ea8a9ac tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:21.078011 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ab4cf7ae-985e-4d71-b976-cea25ea8a9ac tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:21.078724 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ab4cf7ae-985e-4d71-b976-cea25ea8a9ac tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:21.079192 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ab4cf7ae-985e-4d71-b976-cea25ea8a9ac tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:21.281478 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ab4cf7ae-985e-4d71-b976-cea25ea8a9ac tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:21.295900 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cb4d299e-113a-4964-99da-d5678fc7d6fb tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.557812 Dec 15 11:33:21.296996 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 231/461] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Dec 15 11:33:20 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 559 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 15 11:33:21.299783 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ab4cf7ae-985e-4d71-b976-cea25ea8a9ac tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1675 microversion: 2.1 time: 0.235471 Dec 15 11:33:21.300346 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 231/462] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:21 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1675 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:21.315843 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7eec6816-6173-4bcc-9c0a-f9cd0f20adad tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] Calling method '.version_select at 0x7fdf5992a0d0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:21.371956 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7eec6816-6173-4bcc-9c0a-f9cd0f20adad tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9" status: 200 len: 352 microversion: 2.1 time: 0.060797 Dec 15 11:33:21.372527 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 232/463] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:33:21 2021] GET /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:21.871384 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3ce4f79a-6435-4eee-a34b-c5c398a8900e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:21.872740 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3ce4f79a-6435-4eee-a34b-c5c398a8900e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:21.880024 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3ce4f79a-6435-4eee-a34b-c5c398a8900e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:21.880475 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3ce4f79a-6435-4eee-a34b-c5c398a8900e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:21.881265 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3ce4f79a-6435-4eee-a34b-c5c398a8900e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:21.881696 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3ce4f79a-6435-4eee-a34b-c5c398a8900e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:22.011791 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-3ce4f79a-6435-4eee-a34b-c5c398a8900e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:22.019870 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3ce4f79a-6435-4eee-a34b-c5c398a8900e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.154230 Dec 15 11:33:22.020461 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 232/464] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:21 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:22.081289 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-73be05f4-3ff8-4353-900e-e4f47731b3de tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:22.082030 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-73be05f4-3ff8-4353-900e-e4f47731b3de tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:22.088728 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73be05f4-3ff8-4353-900e-e4f47731b3de tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:22.089518 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73be05f4-3ff8-4353-900e-e4f47731b3de tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:22.090398 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73be05f4-3ff8-4353-900e-e4f47731b3de tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:22.090866 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73be05f4-3ff8-4353-900e-e4f47731b3de tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:22.230149 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-73be05f4-3ff8-4353-900e-e4f47731b3de tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:22.239364 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-73be05f4-3ff8-4353-900e-e4f47731b3de tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:22.241679 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-73be05f4-3ff8-4353-900e-e4f47731b3de tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:22.243560 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-73be05f4-3ff8-4353-900e-e4f47731b3de tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.166203 Dec 15 11:33:22.250825 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 233/465] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:22 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:22.316826 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e7d6a546-6284-4ed0-b513-0652e5348760 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:22.317719 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e7d6a546-6284-4ed0-b513-0652e5348760 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:22.324507 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e7d6a546-6284-4ed0-b513-0652e5348760 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:22.324964 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e7d6a546-6284-4ed0-b513-0652e5348760 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:22.325752 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e7d6a546-6284-4ed0-b513-0652e5348760 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:22.326217 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e7d6a546-6284-4ed0-b513-0652e5348760 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:22.385127 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-88455a48-b5a5-495c-a007-9728084a0203 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] Calling method '.version_select at 0x7fdf59987670>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:22.444993 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-88455a48-b5a5-495c-a007-9728084a0203 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9" status: 200 len: 353 microversion: 2.1 time: 0.063675 Dec 15 11:33:22.445562 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 234/466] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:33:22 2021] GET /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:33:22.456650 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4c4444cb-6273-49a7-afd9-3e54a6241fe8 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] Calling method '.version_select at 0x7fdf59959310>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:22.482087 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e7d6a546-6284-4ed0-b513-0652e5348760 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:22.490184 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e7d6a546-6284-4ed0-b513-0652e5348760 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1675 microversion: 2.1 time: 0.177162 Dec 15 11:33:22.491229 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 233/467] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:22 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:22.521926 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4c4444cb-6273-49a7-afd9-3e54a6241fe8 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9" status: 200 len: 353 microversion: 2.1 time: 0.069414 Dec 15 11:33:22.522536 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 235/468] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:33:22 2021] GET /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9 => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:33:22.534384 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-bb1cf913-19aa-4c89-ad7a-877bb28cdb72 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] Calling method '.version_select at 0x7fdf59ae6700>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:22.601395 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-bb1cf913-19aa-4c89-ad7a-877bb28cdb72 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9" status: 202 len: 0 microversion: 2.1 time: 0.070832 Dec 15 11:33:22.602046 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 234/469] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 11:33:22 2021] DELETE /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:33:22.609718 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f8c4e3ef-8578-476c-b637-3242e46d52d9 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] Calling method '.version_select at 0x7fdf59959820>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:22.661206 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f8c4e3ef-8578-476c-b637-3242e46d52d9 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9" status: 200 len: 352 microversion: 2.1 time: 0.055009 Dec 15 11:33:22.661816 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 236/470] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:33:22 2021] GET /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:23.036721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7b3355c9-578a-4132-8403-10bc72f6ca5d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:23.037321 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7b3355c9-578a-4132-8403-10bc72f6ca5d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:23.043430 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7b3355c9-578a-4132-8403-10bc72f6ca5d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:23.043873 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7b3355c9-578a-4132-8403-10bc72f6ca5d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:23.044656 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7b3355c9-578a-4132-8403-10bc72f6ca5d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:23.045081 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7b3355c9-578a-4132-8403-10bc72f6ca5d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:23.181755 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7b3355c9-578a-4132-8403-10bc72f6ca5d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:23.190296 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7b3355c9-578a-4132-8403-10bc72f6ca5d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.157648 Dec 15 11:33:23.191208 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 235/471] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:23 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:23.262656 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-444f8b0b-4571-43d0-ad68-2594e0efb525 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:23.263263 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-444f8b0b-4571-43d0-ad68-2594e0efb525 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:23.269449 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-444f8b0b-4571-43d0-ad68-2594e0efb525 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:23.269882 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-444f8b0b-4571-43d0-ad68-2594e0efb525 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:23.270685 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-444f8b0b-4571-43d0-ad68-2594e0efb525 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:23.271111 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-444f8b0b-4571-43d0-ad68-2594e0efb525 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:23.419037 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-444f8b0b-4571-43d0-ad68-2594e0efb525 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:23.428487 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-444f8b0b-4571-43d0-ad68-2594e0efb525 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:23.429981 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-444f8b0b-4571-43d0-ad68-2594e0efb525 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:23.431258 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-444f8b0b-4571-43d0-ad68-2594e0efb525 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.172673 Dec 15 11:33:23.432500 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 237/472] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:23 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:23.507380 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-272e50cb-860b-43cb-b2dd-89288f2a9745 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:23.508033 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-272e50cb-860b-43cb-b2dd-89288f2a9745 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:23.514018 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-272e50cb-860b-43cb-b2dd-89288f2a9745 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:23.514535 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-272e50cb-860b-43cb-b2dd-89288f2a9745 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:23.515787 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-272e50cb-860b-43cb-b2dd-89288f2a9745 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:23.516368 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-272e50cb-860b-43cb-b2dd-89288f2a9745 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:23.664403 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-272e50cb-860b-43cb-b2dd-89288f2a9745 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:23.673329 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8b46f05a-5101-44ae-be99-f7e31379be03 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] Calling method '.version_select at 0x7fdf599593a0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:23.674519 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-272e50cb-860b-43cb-b2dd-89288f2a9745 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1675 microversion: 2.1 time: 0.170594 Dec 15 11:33:23.675480 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 236/473] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:23 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:23.700666 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-8b46f05a-5101-44ae-be99-f7e31379be03 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] HTTP exception thrown: Volume da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9 could not be found. Dec 15 11:33:23.701450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8b46f05a-5101-44ae-be99-f7e31379be03 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] Returning 404 to user: Volume da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:33:23.702281 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8b46f05a-5101-44ae-be99-f7e31379be03 tempest-VolumesGetTestJSON-2072773067 tempest-VolumesGetTestJSON-2072773067-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9" status: 404 len: 109 microversion: 2.1 time: 0.032871 Dec 15 11:33:23.702867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 238/474] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:33:23 2021] GET /compute/v2.1/os-volumes/da6155b5-f4c2-4d7a-b716-6cbf3b76b7f9 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 11:33:24.210327 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-caa28f60-c2cc-4896-9515-b0aee8b6e480 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:24.212388 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-caa28f60-c2cc-4896-9515-b0aee8b6e480 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:24.220293 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-caa28f60-c2cc-4896-9515-b0aee8b6e480 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:24.221354 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-caa28f60-c2cc-4896-9515-b0aee8b6e480 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:24.222267 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-caa28f60-c2cc-4896-9515-b0aee8b6e480 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:24.222630 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-caa28f60-c2cc-4896-9515-b0aee8b6e480 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:24.407295 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-caa28f60-c2cc-4896-9515-b0aee8b6e480 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:24.416190 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-caa28f60-c2cc-4896-9515-b0aee8b6e480 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.211925 Dec 15 11:33:24.430878 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 237/475] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:24 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:24.450687 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-48365307-6563-4b2b-b1cd-0e11a0b3934b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:24.451393 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-48365307-6563-4b2b-b1cd-0e11a0b3934b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:24.463149 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-48365307-6563-4b2b-b1cd-0e11a0b3934b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:24.464544 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-48365307-6563-4b2b-b1cd-0e11a0b3934b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:24.466106 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-48365307-6563-4b2b-b1cd-0e11a0b3934b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:24.466581 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-48365307-6563-4b2b-b1cd-0e11a0b3934b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:24.691820 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b7380488-0cc6-4991-9154-e3965984d100 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:24.692501 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-48365307-6563-4b2b-b1cd-0e11a0b3934b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:24.692952 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b7380488-0cc6-4991-9154-e3965984d100 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:24.703037 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-48365307-6563-4b2b-b1cd-0e11a0b3934b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:24.703933 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b7380488-0cc6-4991-9154-e3965984d100 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:24.704414 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b7380488-0cc6-4991-9154-e3965984d100 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:24.705992 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-48365307-6563-4b2b-b1cd-0e11a0b3934b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:24.707435 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-48365307-6563-4b2b-b1cd-0e11a0b3934b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.262102 Dec 15 11:33:24.708056 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b7380488-0cc6-4991-9154-e3965984d100 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:24.708510 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b7380488-0cc6-4991-9154-e3965984d100 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:24.719695 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 239/476] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:24 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:24.873618 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b7380488-0cc6-4991-9154-e3965984d100 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:24.882705 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b7380488-0cc6-4991-9154-e3965984d100 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1675 microversion: 2.1 time: 0.195273 Dec 15 11:33:24.883371 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 238/477] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:24 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1675 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:33:25.437134 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-eadfe094-cece-46c5-b7eb-ec1df1f45b6a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:25.437778 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-eadfe094-cece-46c5-b7eb-ec1df1f45b6a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:25.444938 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eadfe094-cece-46c5-b7eb-ec1df1f45b6a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:25.445393 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eadfe094-cece-46c5-b7eb-ec1df1f45b6a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:25.446183 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eadfe094-cece-46c5-b7eb-ec1df1f45b6a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:25.455055 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eadfe094-cece-46c5-b7eb-ec1df1f45b6a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:25.600443 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-eadfe094-cece-46c5-b7eb-ec1df1f45b6a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:25.608727 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-eadfe094-cece-46c5-b7eb-ec1df1f45b6a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.175156 Dec 15 11:33:25.609302 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 240/478] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:25 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:25.727102 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-275ba16f-6343-4150-b139-d8fe6fa77f7f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:25.727733 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-275ba16f-6343-4150-b139-d8fe6fa77f7f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:25.734422 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-275ba16f-6343-4150-b139-d8fe6fa77f7f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:25.734902 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-275ba16f-6343-4150-b139-d8fe6fa77f7f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:25.735711 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-275ba16f-6343-4150-b139-d8fe6fa77f7f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:25.736179 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-275ba16f-6343-4150-b139-d8fe6fa77f7f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:25.875508 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-275ba16f-6343-4150-b139-d8fe6fa77f7f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:25.883940 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-275ba16f-6343-4150-b139-d8fe6fa77f7f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:25.885375 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-275ba16f-6343-4150-b139-d8fe6fa77f7f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:25.886520 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-275ba16f-6343-4150-b139-d8fe6fa77f7f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.163201 Dec 15 11:33:25.887111 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 239/479] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:25 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:25.900251 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f54223fd-33e4-4589-b075-0c087e3637bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:25.900865 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f54223fd-33e4-4589-b075-0c087e3637bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:25.906552 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f54223fd-33e4-4589-b075-0c087e3637bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:25.907022 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f54223fd-33e4-4589-b075-0c087e3637bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:25.908398 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f54223fd-33e4-4589-b075-0c087e3637bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:25.908962 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f54223fd-33e4-4589-b075-0c087e3637bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:26.037898 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f54223fd-33e4-4589-b075-0c087e3637bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:26.052047 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f54223fd-33e4-4589-b075-0c087e3637bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1675 microversion: 2.1 time: 0.155343 Dec 15 11:33:26.052625 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 241/480] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:25 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:26.627336 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7efa678d-4da0-401e-8d7e-6f23bc6fb76d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:26.627959 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7efa678d-4da0-401e-8d7e-6f23bc6fb76d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:26.633759 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7efa678d-4da0-401e-8d7e-6f23bc6fb76d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:26.634211 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7efa678d-4da0-401e-8d7e-6f23bc6fb76d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:26.635035 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7efa678d-4da0-401e-8d7e-6f23bc6fb76d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:26.635725 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7efa678d-4da0-401e-8d7e-6f23bc6fb76d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:26.779615 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2a1b751e-d4bf-456c-b3df-346246209d7a tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] Calling method '.version_select at 0x7fdf5999eb80>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:26.855639 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2a1b751e-d4bf-456c-b3df-346246209d7a tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b68f7636-7523-4e25-b731-40a84e2cd1b3" status: 200 len: 351 microversion: 2.1 time: 0.081257 Dec 15 11:33:26.867051 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 242/481] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:33:26 2021] GET /compute/v2.1/os-volumes/b68f7636-7523-4e25-b731-40a84e2cd1b3 => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:26.898297 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7efa678d-4da0-401e-8d7e-6f23bc6fb76d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:26.906631 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-083cd8e9-96d0-4010-a5c2-82663016a71f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:26.907855 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-083cd8e9-96d0-4010-a5c2-82663016a71f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:26.909093 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7efa678d-4da0-401e-8d7e-6f23bc6fb76d tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.285706 Dec 15 11:33:26.915551 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-083cd8e9-96d0-4010-a5c2-82663016a71f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:26.916204 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-083cd8e9-96d0-4010-a5c2-82663016a71f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:26.919510 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-083cd8e9-96d0-4010-a5c2-82663016a71f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:26.920028 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 240/482] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:26 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:26.920369 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-083cd8e9-96d0-4010-a5c2-82663016a71f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:27.069753 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-aa821924-abb8-48f6-8625-418ad4e66a46 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:27.070491 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-aa821924-abb8-48f6-8625-418ad4e66a46 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:27.083581 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-aa821924-abb8-48f6-8625-418ad4e66a46 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:27.093687 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-aa821924-abb8-48f6-8625-418ad4e66a46 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:27.094775 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-aa821924-abb8-48f6-8625-418ad4e66a46 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:27.096465 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-aa821924-abb8-48f6-8625-418ad4e66a46 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:27.131734 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-083cd8e9-96d0-4010-a5c2-82663016a71f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:27.170271 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-083cd8e9-96d0-4010-a5c2-82663016a71f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:27.180961 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-083cd8e9-96d0-4010-a5c2-82663016a71f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:27.184863 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-083cd8e9-96d0-4010-a5c2-82663016a71f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1806 microversion: 2.20 time: 0.280789 Dec 15 11:33:27.199022 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 243/483] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:26 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1806 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:33:27.219522 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-0826a357-6b0f-4053-98f2-8be6f71e5eb6 req-41ec8e53-6755-4e6c-8c08-9ba43ba8f460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6c539d-01cf-4bf1-adb2-78f4278501da", "tag": "ca19bc92-54c5-4adf-83df-60896fc0b0e4"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:27.223269 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:33:27.223269 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:33:27.244164 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-0826a357-6b0f-4053-98f2-8be6f71e5eb6 req-41ec8e53-6755-4e6c-8c08-9ba43ba8f460 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:27.244612 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-0826a357-6b0f-4053-98f2-8be6f71e5eb6 req-41ec8e53-6755-4e6c-8c08-9ba43ba8f460 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:27.273506 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-0826a357-6b0f-4053-98f2-8be6f71e5eb6 req-41ec8e53-6755-4e6c-8c08-9ba43ba8f460 service nova] Creating event network-changed:ca19bc92-54c5-4adf-83df-60896fc0b0e4 for instance cb6c539d-01cf-4bf1-adb2-78f4278501da on hv-cinder-81321 Dec 15 11:33:27.284963 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-0826a357-6b0f-4053-98f2-8be6f71e5eb6 req-41ec8e53-6755-4e6c-8c08-9ba43ba8f460 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082964 Dec 15 11:33:27.291157 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 244/484] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:33:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:27.448241 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-aa821924-abb8-48f6-8625-418ad4e66a46 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:27.454647 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-aa821924-abb8-48f6-8625-418ad4e66a46 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1652 microversion: 2.1 time: 0.388681 Dec 15 11:33:27.455589 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 241/485] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:27 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1652 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:33:27.472996 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-98ebc9a9-0cd9-4557-8986-64bdf19a9444 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:27.479717 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98ebc9a9-0cd9-4557-8986-64bdf19a9444 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:27.480161 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98ebc9a9-0cd9-4557-8986-64bdf19a9444 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:27.507783 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-98ebc9a9-0cd9-4557-8986-64bdf19a9444 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Going to try to start instance {{(pid=116083) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 11:33:27.563646 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-98ebc9a9-0cd9-4557-8986-64bdf19a9444 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action" status: 202 len: 0 microversion: 2.1 time: 0.095464 Dec 15 11:33:27.570610 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 245/486] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:33:27 2021] POST /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:33:27.577079 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f0db27dc-1022-4494-b10a-a8e4d7ca50ad tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:27.577696 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f0db27dc-1022-4494-b10a-a8e4d7ca50ad tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:27.584967 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f0db27dc-1022-4494-b10a-a8e4d7ca50ad tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:27.585669 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f0db27dc-1022-4494-b10a-a8e4d7ca50ad tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:27.586781 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f0db27dc-1022-4494-b10a-a8e4d7ca50ad tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:27.587443 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f0db27dc-1022-4494-b10a-a8e4d7ca50ad tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:27.801979 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f0db27dc-1022-4494-b10a-a8e4d7ca50ad tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:27.809670 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f0db27dc-1022-4494-b10a-a8e4d7ca50ad tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1661 microversion: 2.1 time: 0.240552 Dec 15 11:33:27.810287 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 242/487] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:27 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1661 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:27.928786 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-70e2cce1-1db0-4470-831e-5c699b208e66 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:27.929505 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-70e2cce1-1db0-4470-831e-5c699b208e66 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:27.936158 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-70e2cce1-1db0-4470-831e-5c699b208e66 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:27.936569 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-70e2cce1-1db0-4470-831e-5c699b208e66 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:27.937377 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-70e2cce1-1db0-4470-831e-5c699b208e66 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:27.937815 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-70e2cce1-1db0-4470-831e-5c699b208e66 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:28.205731 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2d6d349f-73c2-40f5-9056-14d2347bb720 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:28.206344 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2d6d349f-73c2-40f5-9056-14d2347bb720 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:28.212964 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d6d349f-73c2-40f5-9056-14d2347bb720 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:28.213416 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d6d349f-73c2-40f5-9056-14d2347bb720 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:28.214475 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d6d349f-73c2-40f5-9056-14d2347bb720 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:28.214935 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d6d349f-73c2-40f5-9056-14d2347bb720 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:28.369161 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-70e2cce1-1db0-4470-831e-5c699b208e66 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:28.378174 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-70e2cce1-1db0-4470-831e-5c699b208e66 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.454610 Dec 15 11:33:28.379469 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 246/488] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:27 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:28.393872 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9c865e24-b6c4-4706-b83e-7a12610c0bbb tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] Calling method '.version_select at 0x7fdf59987ee0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:28.414164 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2d6d349f-73c2-40f5-9056-14d2347bb720 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:28.424456 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2d6d349f-73c2-40f5-9056-14d2347bb720 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:28.426331 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2d6d349f-73c2-40f5-9056-14d2347bb720 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:28.427945 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2d6d349f-73c2-40f5-9056-14d2347bb720 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1793 microversion: 2.20 time: 0.226565 Dec 15 11:33:28.442607 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 243/489] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:28 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1793 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:33:28.454505 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9c865e24-b6c4-4706-b83e-7a12610c0bbb tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/3bb49661-319a-4498-a40f-9ed8595b0527" status: 200 len: 351 microversion: 2.1 time: 0.065263 Dec 15 11:33:28.456439 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 247/490] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:33:28 2021] GET /compute/v2.1/os-volumes/3bb49661-319a-4498-a40f-9ed8595b0527 => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:28.829272 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-23bea5c6-e9ec-4bb8-9eba-92925997634a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:28.830664 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-23bea5c6-e9ec-4bb8-9eba-92925997634a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:28.836884 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-23bea5c6-e9ec-4bb8-9eba-92925997634a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:28.837336 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-23bea5c6-e9ec-4bb8-9eba-92925997634a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:28.838110 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-23bea5c6-e9ec-4bb8-9eba-92925997634a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:28.838553 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-23bea5c6-e9ec-4bb8-9eba-92925997634a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:28.981001 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-23bea5c6-e9ec-4bb8-9eba-92925997634a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:28.988644 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-23bea5c6-e9ec-4bb8-9eba-92925997634a tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1661 microversion: 2.1 time: 0.163002 Dec 15 11:33:28.989207 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 244/491] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:28 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1661 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:29.396700 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5cf0958a-1635-4abe-83a5-3ced02be1460 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:29.397299 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5cf0958a-1635-4abe-83a5-3ced02be1460 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:29.403233 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5cf0958a-1635-4abe-83a5-3ced02be1460 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:29.403671 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5cf0958a-1635-4abe-83a5-3ced02be1460 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:29.404432 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5cf0958a-1635-4abe-83a5-3ced02be1460 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:29.404857 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5cf0958a-1635-4abe-83a5-3ced02be1460 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:29.535961 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5cf0958a-1635-4abe-83a5-3ced02be1460 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:29.543263 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5cf0958a-1635-4abe-83a5-3ced02be1460 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.151291 Dec 15 11:33:29.543829 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 248/492] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:29 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:29.768572 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ff0a4dff-1d47-4fec-b2d4-d1830997d36e tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] Calling method '.version_select at 0x7fdf59a9a5e0>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:29.816346 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ff0a4dff-1d47-4fec-b2d4-d1830997d36e tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/86dbc919-0898-489e-b7e7-c31ee037c061" status: 200 len: 350 microversion: 2.1 time: 0.051372 Dec 15 11:33:29.816942 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 245/493] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 11:33:29 2021] GET /compute/v2.1/os-volumes/86dbc919-0898-489e-b7e7-c31ee037c061 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:29.827605 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4e7047d2-a495-486a-85c1-1786af093806 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] Calling method '.version_select at 0x7fdf59b5a670>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:29.910376 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4e7047d2-a495-486a-85c1-1786af093806 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086248 Dec 15 11:33:29.910990 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 249/494] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Dec 15 11:33:29 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:29.924472 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6ff9c976-e6f1-4aab-992f-0e7fe231ac60 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] Calling method '.version_select at 0x7fdf599b9280>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:30.003062 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6ff9c976-e6f1-4aab-992f-0e7fe231ac60 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083219 Dec 15 11:33:30.003622 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 246/495] 10.222.0.18 () {58 vars in 1148 bytes} [Wed Dec 15 11:33:29 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:30.004877 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7caa4aba-8c84-42ff-9337-c446bfad5e77 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:30.005487 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7caa4aba-8c84-42ff-9337-c446bfad5e77 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:30.011595 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7caa4aba-8c84-42ff-9337-c446bfad5e77 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:30.012042 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7caa4aba-8c84-42ff-9337-c446bfad5e77 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:30.012816 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7caa4aba-8c84-42ff-9337-c446bfad5e77 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:30.013249 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7caa4aba-8c84-42ff-9337-c446bfad5e77 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:30.014757 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-43dcfa5b-b66e-425f-b3c7-1b28047cec7d tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] Calling method '.version_select at 0x7fdf5996f280>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:30.084806 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:33:30.084979 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: Wed Dec 15 11:33:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.18) !!! Dec 15 11:33:30.097052 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-43dcfa5b-b66e-425f-b3c7-1b28047cec7d tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085602 Dec 15 11:33:30.097619 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 247/496] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Dec 15 11:33:30 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:33:30.108438 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-87bfd5fb-55e8-4bd2-86e9-b72d21c8811e tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] Calling method '.version_select at 0x7fdf599b9c10>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:30.146946 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7caa4aba-8c84-42ff-9337-c446bfad5e77 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:30.154375 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7caa4aba-8c84-42ff-9337-c446bfad5e77 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1665 microversion: 2.1 time: 0.153081 Dec 15 11:33:30.154973 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 250/497] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:30 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:33:30.187748 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-87bfd5fb-55e8-4bd2-86e9-b72d21c8811e tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082616 Dec 15 11:33:30.188311 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 248/498] 10.222.0.18 () {58 vars in 1166 bytes} [Wed Dec 15 11:33:30 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:30.199573 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8fadb1dd-7bb8-4897-a790-75c28fb4ff06 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] Calling method '.version_select at 0x7fdf59a1f9d0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:30.278042 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8fadb1dd-7bb8-4897-a790-75c28fb4ff06 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.081893 Dec 15 11:33:30.278640 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 251/499] 10.222.0.18 () {58 vars in 1169 bytes} [Wed Dec 15 11:33:30 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:30.290662 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-062e33eb-6438-427b-ad68-a98c84e4ef14 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] Calling method '.version_select at 0x7fdf59b3e8b0>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:30.367681 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-062e33eb-6438-427b-ad68-a98c84e4ef14 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.080409 Dec 15 11:33:30.368692 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 249/500] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Dec 15 11:33:30 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:30.380830 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3406a49e-da91-445a-ae61-2c19d159cd60 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] Calling method '.version_select at 0x7fdf59959790>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:30.457009 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3406a49e-da91-445a-ae61-2c19d159cd60 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.081220 Dec 15 11:33:30.457596 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 252/501] 10.222.0.18 () {58 vars in 1187 bytes} [Wed Dec 15 11:33:30 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:30.468896 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-273c92d1-fd89-4682-9655-d9e97eb957a6 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] Calling method '.version_select at 0x7fdf59ac39d0>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:30.545909 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-273c92d1-fd89-4682-9655-d9e97eb957a6 tempest-VolumesTestJSON-172787512 tempest-VolumesTestJSON-172787512-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.080497 Dec 15 11:33:30.546465 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 250/502] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Dec 15 11:33:30 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:30.562707 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-edd7ca9c-84fe-48c3-b13c-d8a6f147e7b7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:30.563456 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-edd7ca9c-84fe-48c3-b13c-d8a6f147e7b7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:30.569892 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edd7ca9c-84fe-48c3-b13c-d8a6f147e7b7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:30.570338 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edd7ca9c-84fe-48c3-b13c-d8a6f147e7b7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:30.571145 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edd7ca9c-84fe-48c3-b13c-d8a6f147e7b7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:30.571576 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edd7ca9c-84fe-48c3-b13c-d8a6f147e7b7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:30.706618 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-edd7ca9c-84fe-48c3-b13c-d8a6f147e7b7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:30.713754 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-edd7ca9c-84fe-48c3-b13c-d8a6f147e7b7 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.154777 Dec 15 11:33:30.714604 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 253/503] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:30 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:31.732364 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-44927942-1d7d-4c96-ade9-a5dc470a8012 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:31.732364 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-44927942-1d7d-4c96-ade9-a5dc470a8012 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:31.740479 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-44927942-1d7d-4c96-ade9-a5dc470a8012 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:31.740936 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-44927942-1d7d-4c96-ade9-a5dc470a8012 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:31.741721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-44927942-1d7d-4c96-ade9-a5dc470a8012 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:31.742159 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-44927942-1d7d-4c96-ade9-a5dc470a8012 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:31.874429 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-44927942-1d7d-4c96-ade9-a5dc470a8012 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:31.882439 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-44927942-1d7d-4c96-ade9-a5dc470a8012 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.154830 Dec 15 11:33:31.883060 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 251/504] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:31 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:32.902919 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-03ea7c29-1cec-4368-a9ef-b1ebf57501f1 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:32.903680 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-03ea7c29-1cec-4368-a9ef-b1ebf57501f1 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:32.910296 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-03ea7c29-1cec-4368-a9ef-b1ebf57501f1 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:32.910866 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-03ea7c29-1cec-4368-a9ef-b1ebf57501f1 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:32.911649 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-03ea7c29-1cec-4368-a9ef-b1ebf57501f1 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:32.912127 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-03ea7c29-1cec-4368-a9ef-b1ebf57501f1 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:33.043085 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-2b164a7b-e44d-43f6-874d-bfbea32bd860 req-c69e1467-6bf5-44d2-b7d8-b4a416786451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb6c539d-01cf-4bf1-adb2-78f4278501da", "name": "network-vif-plugged", "status": "completed", "tag": "ca19bc92-54c5-4adf-83df-60896fc0b0e4"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:33.044887 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:33:33.044887 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:33:33.050443 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-03ea7c29-1cec-4368-a9ef-b1ebf57501f1 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:33.055164 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-2b164a7b-e44d-43f6-874d-bfbea32bd860 req-c69e1467-6bf5-44d2-b7d8-b4a416786451 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:33.055609 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-2b164a7b-e44d-43f6-874d-bfbea32bd860 req-c69e1467-6bf5-44d2-b7d8-b4a416786451 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:33.058867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-03ea7c29-1cec-4368-a9ef-b1ebf57501f1 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.159369 Dec 15 11:33:33.059625 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 254/505] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:32 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:33.077240 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-2b164a7b-e44d-43f6-874d-bfbea32bd860 req-c69e1467-6bf5-44d2-b7d8-b4a416786451 service nova] Creating event network-vif-plugged:ca19bc92-54c5-4adf-83df-60896fc0b0e4 for instance cb6c539d-01cf-4bf1-adb2-78f4278501da on hv-cinder-81321 Dec 15 11:33:33.083246 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-2b164a7b-e44d-43f6-874d-bfbea32bd860 req-c69e1467-6bf5-44d2-b7d8-b4a416786451 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043912 Dec 15 11:33:33.083832 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 252/506] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:33:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:34.076166 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b5f1dddd-0135-4607-bbbb-5e0a9e579dff tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:34.076780 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b5f1dddd-0135-4607-bbbb-5e0a9e579dff tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:34.084608 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5f1dddd-0135-4607-bbbb-5e0a9e579dff tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:34.085065 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5f1dddd-0135-4607-bbbb-5e0a9e579dff tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:34.086030 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5f1dddd-0135-4607-bbbb-5e0a9e579dff tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:34.086480 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b5f1dddd-0135-4607-bbbb-5e0a9e579dff tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:34.216258 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b5f1dddd-0135-4607-bbbb-5e0a9e579dff tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:34.224340 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b5f1dddd-0135-4607-bbbb-5e0a9e579dff tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1358 microversion: 2.1 time: 0.151829 Dec 15 11:33:34.225021 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 255/507] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:34 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:35.242074 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-21987163-ea4b-4824-859a-8f81ffb7f3b5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:35.242830 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-21987163-ea4b-4824-859a-8f81ffb7f3b5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:35.248748 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-21987163-ea4b-4824-859a-8f81ffb7f3b5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:35.249199 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-21987163-ea4b-4824-859a-8f81ffb7f3b5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:35.249980 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-21987163-ea4b-4824-859a-8f81ffb7f3b5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:35.250418 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-21987163-ea4b-4824-859a-8f81ffb7f3b5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:35.385126 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-21987163-ea4b-4824-859a-8f81ffb7f3b5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:35.392965 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-21987163-ea4b-4824-859a-8f81ffb7f3b5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1548 microversion: 2.1 time: 0.154834 Dec 15 11:33:35.393528 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 253/508] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:35 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:35.410949 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f4ac7d56-348e-47f2-b852-cb0716b89972 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:35.411559 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f4ac7d56-348e-47f2-b852-cb0716b89972 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:35.420652 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f4ac7d56-348e-47f2-b852-cb0716b89972 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:35.421096 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f4ac7d56-348e-47f2-b852-cb0716b89972 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:35.421883 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f4ac7d56-348e-47f2-b852-cb0716b89972 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:35.422308 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f4ac7d56-348e-47f2-b852-cb0716b89972 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:35.558054 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f4ac7d56-348e-47f2-b852-cb0716b89972 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:35.566054 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f4ac7d56-348e-47f2-b852-cb0716b89972 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1548 microversion: 2.1 time: 0.158827 Dec 15 11:33:35.566662 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 256/509] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:35 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:35.582191 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-248acd9a-db73-4fb4-9289-40b21505d8ae tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:35.585693 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:33:35.585693 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:33:35.586879 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-248acd9a-db73-4fb4-9289-40b21505d8ae tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:35.587700 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-248acd9a-db73-4fb4-9289-40b21505d8ae tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Searching by: {'deleted': False, 'project_id': '9b901444a8394be1ba87483d8001829f'} {{(pid=116082) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 11:33:35.594601 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-248acd9a-db73-4fb4-9289-40b21505d8ae tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:35.595166 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-248acd9a-db73-4fb4-9289-40b21505d8ae tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:35.596176 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-248acd9a-db73-4fb4-9289-40b21505d8ae tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:35.596659 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-248acd9a-db73-4fb4-9289-40b21505d8ae tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:35.685060 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.multi_cell_list [None req-248acd9a-db73-4fb4-9289-40b21505d8ae tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116082) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 11:33:35.782432 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-248acd9a-db73-4fb4-9289-40b21505d8ae tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203858 Dec 15 11:33:35.783075 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 254/510] 10.222.0.18 () {58 vars in 1124 bytes} [Wed Dec 15 11:33:35 2021] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:35.793707 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9ddafa30-5de9-41d0-bbc3-ba8742e42e4e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:35.794323 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9ddafa30-5de9-41d0-bbc3-ba8742e42e4e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:35.801808 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9ddafa30-5de9-41d0-bbc3-ba8742e42e4e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:35.801808 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9ddafa30-5de9-41d0-bbc3-ba8742e42e4e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:35.802291 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9ddafa30-5de9-41d0-bbc3-ba8742e42e4e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:35.802758 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9ddafa30-5de9-41d0-bbc3-ba8742e42e4e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:35.933918 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9ddafa30-5de9-41d0-bbc3-ba8742e42e4e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:35.942549 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9ddafa30-5de9-41d0-bbc3-ba8742e42e4e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1548 microversion: 2.1 time: 0.152543 Dec 15 11:33:35.943138 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 257/511] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:35 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:37.431714 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e70d7421-ffd8-41d9-9db6-a2d8fee821f2 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af414ff4-c764-42e5-ac11-925f22b1d048"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:37.432777 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e70d7421-ffd8-41d9-9db6-a2d8fee821f2 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:37.439001 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e70d7421-ffd8-41d9-9db6-a2d8fee821f2 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:37.440174 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e70d7421-ffd8-41d9-9db6-a2d8fee821f2 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:37.441026 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e70d7421-ffd8-41d9-9db6-a2d8fee821f2 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:37.441470 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e70d7421-ffd8-41d9-9db6-a2d8fee821f2 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:37.669875 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e70d7421-ffd8-41d9-9db6-a2d8fee821f2 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "POST /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241664 Dec 15 11:33:37.670467 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 255/512] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:33:37 2021] POST /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:44.135636 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4ae3e006-76b6-4f36-b6cf-04ef3166dba5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:44.136238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4ae3e006-76b6-4f36-b6cf-04ef3166dba5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:44.142401 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ae3e006-76b6-4f36-b6cf-04ef3166dba5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:44.143476 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ae3e006-76b6-4f36-b6cf-04ef3166dba5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:44.144238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ae3e006-76b6-4f36-b6cf-04ef3166dba5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:44.144667 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ae3e006-76b6-4f36-b6cf-04ef3166dba5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:44.275119 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4ae3e006-76b6-4f36-b6cf-04ef3166dba5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:44.282775 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4ae3e006-76b6-4f36-b6cf-04ef3166dba5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1594 microversion: 2.1 time: 0.150660 Dec 15 11:33:44.283372 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 258/513] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:44 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1594 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:46.008463 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-01b371b5-90fd-4fde-9a8e-be771a996dc6 req-e92ce36b-d711-4bdd-b385-b6efd7ea3c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6c539d-01cf-4bf1-adb2-78f4278501da", "tag": "ca19bc92-54c5-4adf-83df-60896fc0b0e4"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:46.010090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:33:46.010090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:33:46.019531 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-01b371b5-90fd-4fde-9a8e-be771a996dc6 req-e92ce36b-d711-4bdd-b385-b6efd7ea3c82 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:46.019976 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-01b371b5-90fd-4fde-9a8e-be771a996dc6 req-e92ce36b-d711-4bdd-b385-b6efd7ea3c82 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:46.031368 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-01b371b5-90fd-4fde-9a8e-be771a996dc6 req-e92ce36b-d711-4bdd-b385-b6efd7ea3c82 service nova] Creating event network-changed:ca19bc92-54c5-4adf-83df-60896fc0b0e4 for instance cb6c539d-01cf-4bf1-adb2-78f4278501da on hv-cinder-81321 Dec 15 11:33:46.037079 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-01b371b5-90fd-4fde-9a8e-be771a996dc6 req-e92ce36b-d711-4bdd-b385-b6efd7ea3c82 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032950 Dec 15 11:33:46.038050 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 256/514] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:33:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:47.089978 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4e1fc09a-378f-461b-84bd-330b92103848 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-614974730"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:47.090516 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4e1fc09a-378f-461b-84bd-330b92103848 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:47.097698 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e1fc09a-378f-461b-84bd-330b92103848 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:47.098138 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e1fc09a-378f-461b-84bd-330b92103848 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:47.098952 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e1fc09a-378f-461b-84bd-330b92103848 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:47.099377 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e1fc09a-378f-461b-84bd-330b92103848 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:47.231086 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.network.security_group_api [None req-4e1fc09a-378f-461b-84bd-330b92103848 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Adding security group 0a1d5d47-2b43-4235-a73f-9682ffea3ec5 to port ca19bc92-54c5-4adf-83df-60896fc0b0e4 Dec 15 11:33:47.607302 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4e1fc09a-378f-461b-84bd-330b92103848 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "POST /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/action" status: 202 len: 0 microversion: 2.1 time: 0.522040 Dec 15 11:33:47.608106 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 259/515] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:33:47 2021] POST /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:33:47.620669 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6efe66e8-41df-4d61-aaca-c0d6dce15dde tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:47.622026 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6efe66e8-41df-4d61-aaca-c0d6dce15dde tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:47.628206 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6efe66e8-41df-4d61-aaca-c0d6dce15dde tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:47.628649 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6efe66e8-41df-4d61-aaca-c0d6dce15dde tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:47.629432 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6efe66e8-41df-4d61-aaca-c0d6dce15dde tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:47.629859 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6efe66e8-41df-4d61-aaca-c0d6dce15dde tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:47.841923 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6efe66e8-41df-4d61-aaca-c0d6dce15dde tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:47.850771 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6efe66e8-41df-4d61-aaca-c0d6dce15dde tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1757 microversion: 2.1 time: 0.237459 Dec 15 11:33:47.851348 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 257/516] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:33:47 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1757 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:33:48.053614 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-067bde4c-ff00-475a-bbb9-a88bf5fc8607 req-fe054fe0-4786-4272-b1e9-262b5f45ddcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6c539d-01cf-4bf1-adb2-78f4278501da", "tag": "ca19bc92-54c5-4adf-83df-60896fc0b0e4"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:48.055290 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:33:48.055290 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:33:48.062155 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-067bde4c-ff00-475a-bbb9-a88bf5fc8607 req-fe054fe0-4786-4272-b1e9-262b5f45ddcf service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:48.062705 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-067bde4c-ff00-475a-bbb9-a88bf5fc8607 req-fe054fe0-4786-4272-b1e9-262b5f45ddcf service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:48.074671 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-067bde4c-ff00-475a-bbb9-a88bf5fc8607 req-fe054fe0-4786-4272-b1e9-262b5f45ddcf service nova] Creating event network-changed:ca19bc92-54c5-4adf-83df-60896fc0b0e4 for instance cb6c539d-01cf-4bf1-adb2-78f4278501da on hv-cinder-81321 Dec 15 11:33:48.079690 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-067bde4c-ff00-475a-bbb9-a88bf5fc8607 req-fe054fe0-4786-4272-b1e9-262b5f45ddcf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030764 Dec 15 11:33:48.080644 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 260/517] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:33:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:33:55.296491 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a5217c3e-f7bc-4208-b992-83bb202b962f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:55.297116 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a5217c3e-f7bc-4208-b992-83bb202b962f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:55.303789 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5217c3e-f7bc-4208-b992-83bb202b962f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:55.304337 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5217c3e-f7bc-4208-b992-83bb202b962f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:55.305194 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5217c3e-f7bc-4208-b992-83bb202b962f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:55.305689 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5217c3e-f7bc-4208-b992-83bb202b962f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:55.342272 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a5217c3e-f7bc-4208-b992-83bb202b962f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-volume_attachments/30f14f1b-b57b-45e0-b2e6-f3b6f0d40b77" status: 200 len: 194 microversion: 2.20 time: 0.049548 Dec 15 11:33:55.343117 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 258/518] 10.222.0.18 () {60 vars in 1453 bytes} [Wed Dec 15 11:33:55 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-volume_attachments/30f14f1b-b57b-45e0-b2e6-f3b6f0d40b77 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:33:55.417201 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cd217a3e-6411-4a18-8bde-0df8c3b5365a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:55.417753 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cd217a3e-6411-4a18-8bde-0df8c3b5365a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:55.423855 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd217a3e-6411-4a18-8bde-0df8c3b5365a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:55.424494 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd217a3e-6411-4a18-8bde-0df8c3b5365a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:55.425264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd217a3e-6411-4a18-8bde-0df8c3b5365a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:55.425693 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd217a3e-6411-4a18-8bde-0df8c3b5365a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:55.503734 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-cd217a3e-6411-4a18-8bde-0df8c3b5365a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lazy-loading 'services' on Instance uuid 0866db17-45ec-4550-b834-8880e974be1d {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:33:55.572172 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cd217a3e-6411-4a18-8bde-0df8c3b5365a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-volume_attachments/30f14f1b-b57b-45e0-b2e6-f3b6f0d40b77" status: 202 len: 0 microversion: 2.20 time: 0.159425 Dec 15 11:33:55.572750 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 261/519] 10.222.0.18 () {60 vars in 1456 bytes} [Wed Dec 15 11:33:55 2021] DELETE /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-volume_attachments/30f14f1b-b57b-45e0-b2e6-f3b6f0d40b77 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:33:55.580993 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3fcf6831-9cfd-4f9f-898b-cce01322f5b1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:55.582197 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3fcf6831-9cfd-4f9f-898b-cce01322f5b1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:55.588370 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3fcf6831-9cfd-4f9f-898b-cce01322f5b1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:55.589143 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3fcf6831-9cfd-4f9f-898b-cce01322f5b1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:55.590204 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3fcf6831-9cfd-4f9f-898b-cce01322f5b1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:55.590745 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3fcf6831-9cfd-4f9f-898b-cce01322f5b1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:55.623158 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3fcf6831-9cfd-4f9f-898b-cce01322f5b1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045731 Dec 15 11:33:55.623837 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 259/520] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 11:33:55 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:33:56.635788 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-879890e5-b5c9-4476-aea2-04c336c74cac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:56.636819 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-879890e5-b5c9-4476-aea2-04c336c74cac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:56.643106 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-879890e5-b5c9-4476-aea2-04c336c74cac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:56.643547 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-879890e5-b5c9-4476-aea2-04c336c74cac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:56.644316 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-879890e5-b5c9-4476-aea2-04c336c74cac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:56.645305 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-879890e5-b5c9-4476-aea2-04c336c74cac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:56.674202 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-879890e5-b5c9-4476-aea2-04c336c74cac tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042989 Dec 15 11:33:56.674813 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 262/521] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 11:33:56 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:33:56.730610 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e0e4b0fc-16f7-4af5-a6a8-3cc4e6c6785c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:56.731241 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e0e4b0fc-16f7-4af5-a6a8-3cc4e6c6785c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:56.737494 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e0e4b0fc-16f7-4af5-a6a8-3cc4e6c6785c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:56.737936 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e0e4b0fc-16f7-4af5-a6a8-3cc4e6c6785c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:56.738874 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e0e4b0fc-16f7-4af5-a6a8-3cc4e6c6785c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:56.739313 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e0e4b0fc-16f7-4af5-a6a8-3cc4e6c6785c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:56.766320 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e0e4b0fc-16f7-4af5-a6a8-3cc4e6c6785c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Going to try to terminate instance {{(pid=116082) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:33:56.855233 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e0e4b0fc-16f7-4af5-a6a8-3cc4e6c6785c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 204 len: 0 microversion: 2.20 time: 0.127648 Dec 15 11:33:56.857030 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 260/522] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 11:33:56 2021] DELETE /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 11:33:56.864974 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3f704722-4a9a-4e34-be36-72d14c8bcca0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:56.865667 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3f704722-4a9a-4e34-be36-72d14c8bcca0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:56.871507 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3f704722-4a9a-4e34-be36-72d14c8bcca0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:56.871951 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3f704722-4a9a-4e34-be36-72d14c8bcca0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:56.872722 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3f704722-4a9a-4e34-be36-72d14c8bcca0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:56.873153 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3f704722-4a9a-4e34-be36-72d14c8bcca0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:57.012524 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3f704722-4a9a-4e34-be36-72d14c8bcca0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:57.021465 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3f704722-4a9a-4e34-be36-72d14c8bcca0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:57.023135 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3f704722-4a9a-4e34-be36-72d14c8bcca0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:57.024355 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3f704722-4a9a-4e34-be36-72d14c8bcca0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.163177 Dec 15 11:33:57.025085 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 263/523] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:56 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:33:58.043612 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-312effb3-a012-4d57-984b-4eead9d14de3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:58.044391 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-312effb3-a012-4d57-984b-4eead9d14de3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:58.050627 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-312effb3-a012-4d57-984b-4eead9d14de3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:58.051213 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-312effb3-a012-4d57-984b-4eead9d14de3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:58.052179 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-312effb3-a012-4d57-984b-4eead9d14de3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:58.052609 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-312effb3-a012-4d57-984b-4eead9d14de3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:58.184350 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-312effb3-a012-4d57-984b-4eead9d14de3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:58.192911 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-312effb3-a012-4d57-984b-4eead9d14de3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:58.194413 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-312effb3-a012-4d57-984b-4eead9d14de3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:58.195663 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-312effb3-a012-4d57-984b-4eead9d14de3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1721 microversion: 2.20 time: 0.155992 Dec 15 11:33:58.196188 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 261/524] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:58 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:59.213259 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2c50319c-fc28-436c-8197-6f72f8626b65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:33:59.213870 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2c50319c-fc28-436c-8197-6f72f8626b65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:33:59.222533 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c50319c-fc28-436c-8197-6f72f8626b65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:59.223806 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c50319c-fc28-436c-8197-6f72f8626b65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:59.224923 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c50319c-fc28-436c-8197-6f72f8626b65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:59.225574 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c50319c-fc28-436c-8197-6f72f8626b65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:59.311411 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2c50319c-fc28-436c-8197-6f72f8626b65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:59.323122 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2c50319c-fc28-436c-8197-6f72f8626b65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:59.324858 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2c50319c-fc28-436c-8197-6f72f8626b65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:33:59.326397 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2c50319c-fc28-436c-8197-6f72f8626b65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 200 len: 1653 microversion: 2.20 time: 0.116830 Dec 15 11:33:59.327388 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 264/525] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:33:59 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 1653 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:33:59.528800 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-887bb6e7-a722-4b90-91e3-22d6aff1943d req-ca8653f2-948c-4b9b-b79a-1784c0bb0f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0866db17-45ec-4550-b834-8880e974be1d", "name": "network-vif-deleted", "tag": "b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:33:59.530852 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:33:59.530852 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:33:59.541251 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-887bb6e7-a722-4b90-91e3-22d6aff1943d req-ca8653f2-948c-4b9b-b79a-1784c0bb0f56 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:33:59.541790 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-887bb6e7-a722-4b90-91e3-22d6aff1943d req-ca8653f2-948c-4b9b-b79a-1784c0bb0f56 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:33:59.557088 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-887bb6e7-a722-4b90-91e3-22d6aff1943d req-ca8653f2-948c-4b9b-b79a-1784c0bb0f56 service nova] Creating event network-vif-deleted:b4f0cc58-a560-43b2-ae05-caa6bd0eaf4d for instance 0866db17-45ec-4550-b834-8880e974be1d on hv-cinder-81321 Dec 15 11:33:59.563909 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-887bb6e7-a722-4b90-91e3-22d6aff1943d req-ca8653f2-948c-4b9b-b79a-1784c0bb0f56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040878 Dec 15 11:33:59.564891 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 262/526] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:33:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:34:00.347279 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2c94849f-2a84-46ee-8dd5-ae96d6890a68 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:00.348459 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2c94849f-2a84-46ee-8dd5-ae96d6890a68 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:00.355328 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c94849f-2a84-46ee-8dd5-ae96d6890a68 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:00.356066 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c94849f-2a84-46ee-8dd5-ae96d6890a68 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:00.357191 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c94849f-2a84-46ee-8dd5-ae96d6890a68 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:00.358263 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c94849f-2a84-46ee-8dd5-ae96d6890a68 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:00.389282 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-2c94849f-2a84-46ee-8dd5-ae96d6890a68 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] HTTP exception thrown: Instance 0866db17-45ec-4550-b834-8880e974be1d could not be found. Dec 15 11:34:00.390215 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2c94849f-2a84-46ee-8dd5-ae96d6890a68 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Returning 404 to user: Instance 0866db17-45ec-4550-b834-8880e974be1d could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:34:00.391079 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2c94849f-2a84-46ee-8dd5-ae96d6890a68 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 404 len: 111 microversion: 2.20 time: 0.047663 Dec 15 11:34:00.391655 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 265/527] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:34:00 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 11:34:00.400646 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-1c257eb3-8f4e-479b-ad2f-8022f3cdcc14 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '.version_select at 0x7fdf598da820>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:00.433123 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-1c257eb3-8f4e-479b-ad2f-8022f3cdcc14 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152253885" status: 204 len: 0 microversion: 2.20 time: 0.036377 Dec 15 11:34:00.438193 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 263/528] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Dec 15 11:34:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152253885 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 11:34:01.680143 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a16a5268-e3fe-4f1d-9c23-f6efc72caf0d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'create', calling method: .version_select at 0x7fdf59a17040>, body: {"keypair": {"name": "tempest-keypair-1023952740"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:01.697008 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-a16a5268-e3fe-4f1d-9c23-f6efc72caf0d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:34:01.701340 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-a16a5268-e3fe-4f1d-9c23-f6efc72caf0d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for user f55f136acecb40ed90a41911e05aa10b and project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:34:02.043566 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-a16a5268-e3fe-4f1d-9c23-f6efc72caf0d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:34:02.048159 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-a16a5268-e3fe-4f1d-9c23-f6efc72caf0d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for user f55f136acecb40ed90a41911e05aa10b and project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:34:02.063108 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a16a5268-e3fe-4f1d-9c23-f6efc72caf0d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.387539 Dec 15 11:34:02.063995 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 266/529] 10.222.0.18 () {62 vars in 1198 bytes} [Wed Dec 15 11:34:01 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 390 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 11:34:03.631891 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-821239775", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "489d15f9-6ae1-4671-9815-ae7c76d0aed9"}], "security_groups": [{"name": "tempest-securitygroup--884274432"}], "key_name": "tempest-keypair-1023952740", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:03.765563 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.network.neutron [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] validate_networks() for [('489d15f9-6ae1-4671-9815-ae7c76d0aed9', None, None, None, None, None)] {{(pid=116082) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:34:04.416039 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Flavor limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:34:04.416645 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Image limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:34:04.417425 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Flavor pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:34:04.417906 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Image pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:34:04.418398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:34:04.429043 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:04.429620 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:04.430520 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:04.431772 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:04.450195 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:34:04.455731 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Getting quotas for user f55f136acecb40ed90a41911e05aa10b and project 1091f449b1dd4715bfc08ff209ce29fb. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:34:04.467598 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Going to run 1 instances... {{(pid=116082) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:34:04.470175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116082) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:34:04.523367 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fc1f2fd1-585d-4321-add1-4cfe34725db4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.895888 Dec 15 11:34:04.524431 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 264/530] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Dec 15 11:34:03 2021] POST /compute/v2.1/servers => generated 401 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 15 11:34:04.537954 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b325e271-e280-4e5b-95d5-f27f65db224e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:04.539438 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b325e271-e280-4e5b-95d5-f27f65db224e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:04.611255 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b325e271-e280-4e5b-95d5-f27f65db224e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:04.622558 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b325e271-e280-4e5b-95d5-f27f65db224e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:04.624389 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b325e271-e280-4e5b-95d5-f27f65db224e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:04.625702 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b325e271-e280-4e5b-95d5-f27f65db224e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1281 microversion: 2.20 time: 0.095083 Dec 15 11:34:04.626297 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 267/531] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:34:04 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:34:05.635594 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-32bb9beb-dad0-46f6-96f5-b2f01f78282e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:05.637220 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-32bb9beb-dad0-46f6-96f5-b2f01f78282e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:05.645790 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-32bb9beb-dad0-46f6-96f5-b2f01f78282e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:05.646350 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-32bb9beb-dad0-46f6-96f5-b2f01f78282e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:05.647295 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-32bb9beb-dad0-46f6-96f5-b2f01f78282e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:05.647994 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-32bb9beb-dad0-46f6-96f5-b2f01f78282e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:05.649366 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-db61ffd4-0a96-4832-a0e3-0ef69e5a0360 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:05.649989 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-db61ffd4-0a96-4832-a0e3-0ef69e5a0360 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:05.662239 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db61ffd4-0a96-4832-a0e3-0ef69e5a0360 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:05.662732 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db61ffd4-0a96-4832-a0e3-0ef69e5a0360 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:05.663601 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db61ffd4-0a96-4832-a0e3-0ef69e5a0360 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:05.664238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db61ffd4-0a96-4832-a0e3-0ef69e5a0360 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:05.686356 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-32bb9beb-dad0-46f6-96f5-b2f01f78282e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055465 Dec 15 11:34:05.693942 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 265/532] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:34:05 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:34:05.785954 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3568bcbf-ccaf-4388-ae62-1c07b89a5b16 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:05.787091 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3568bcbf-ccaf-4388-ae62-1c07b89a5b16 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:05.795340 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3568bcbf-ccaf-4388-ae62-1c07b89a5b16 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:05.796766 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3568bcbf-ccaf-4388-ae62-1c07b89a5b16 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:05.799242 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3568bcbf-ccaf-4388-ae62-1c07b89a5b16 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:05.800070 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3568bcbf-ccaf-4388-ae62-1c07b89a5b16 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:05.809472 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-db61ffd4-0a96-4832-a0e3-0ef69e5a0360 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:05.822590 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-db61ffd4-0a96-4832-a0e3-0ef69e5a0360 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:05.824102 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-db61ffd4-0a96-4832-a0e3-0ef69e5a0360 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:05.825944 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-db61ffd4-0a96-4832-a0e3-0ef69e5a0360 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1341 microversion: 2.20 time: 0.185902 Dec 15 11:34:05.826901 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 268/533] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:34:05 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1341 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:34:05.842924 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3568bcbf-ccaf-4388-ae62-1c07b89a5b16 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Going to try to terminate instance {{(pid=116082) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:34:05.956957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3568bcbf-ccaf-4388-ae62-1c07b89a5b16 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 204 len: 0 microversion: 2.1 time: 0.173379 Dec 15 11:34:05.960053 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 266/534] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:34:05 2021] DELETE /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 11:34:05.968456 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-156dd172-44a3-454a-844b-16d77ec18367 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:05.969415 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-156dd172-44a3-454a-844b-16d77ec18367 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:05.978012 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-156dd172-44a3-454a-844b-16d77ec18367 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:05.978506 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-156dd172-44a3-454a-844b-16d77ec18367 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:05.979336 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-156dd172-44a3-454a-844b-16d77ec18367 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:05.980600 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-156dd172-44a3-454a-844b-16d77ec18367 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:06.169324 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-156dd172-44a3-454a-844b-16d77ec18367 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:06.184617 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-156dd172-44a3-454a-844b-16d77ec18367 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1671 microversion: 2.1 time: 0.220006 Dec 15 11:34:06.185664 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 269/535] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:05 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1671 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:06.845831 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b6982534-6d6e-4a75-9d63-041dac73dc0a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:06.847590 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b6982534-6d6e-4a75-9d63-041dac73dc0a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:06.853772 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b6982534-6d6e-4a75-9d63-041dac73dc0a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:06.856351 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b6982534-6d6e-4a75-9d63-041dac73dc0a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:06.857358 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b6982534-6d6e-4a75-9d63-041dac73dc0a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:06.857941 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b6982534-6d6e-4a75-9d63-041dac73dc0a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:07.083741 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b6982534-6d6e-4a75-9d63-041dac73dc0a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:07.100840 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b6982534-6d6e-4a75-9d63-041dac73dc0a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:07.102451 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b6982534-6d6e-4a75-9d63-041dac73dc0a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:07.103879 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b6982534-6d6e-4a75-9d63-041dac73dc0a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1406 microversion: 2.20 time: 0.262742 Dec 15 11:34:07.105483 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 267/536] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:34:06 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:34:07.206061 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-286de1ad-4d32-4945-86ae-89d266d983a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:07.206744 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-286de1ad-4d32-4945-86ae-89d266d983a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:07.217051 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-286de1ad-4d32-4945-86ae-89d266d983a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:07.217501 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-286de1ad-4d32-4945-86ae-89d266d983a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:07.218303 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-286de1ad-4d32-4945-86ae-89d266d983a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:07.218843 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-286de1ad-4d32-4945-86ae-89d266d983a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:07.452822 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-bb13ffc5-3445-4453-8bdf-9da7cfff8205 req-44ede893-0acb-4dea-a2ca-54eb426b0200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc1474a-92ec-418e-9cd4-3f10cf91c8bd", "tag": "6c0ef6e9-6255-460a-8ffb-7e490afe7546"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:07.454528 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:34:07.454528 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:34:07.470107 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-bb13ffc5-3445-4453-8bdf-9da7cfff8205 req-44ede893-0acb-4dea-a2ca-54eb426b0200 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:07.473962 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-bb13ffc5-3445-4453-8bdf-9da7cfff8205 req-44ede893-0acb-4dea-a2ca-54eb426b0200 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:07.502717 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-bb13ffc5-3445-4453-8bdf-9da7cfff8205 req-44ede893-0acb-4dea-a2ca-54eb426b0200 service nova] Creating event network-changed:6c0ef6e9-6255-460a-8ffb-7e490afe7546 for instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd on hv-cinder-81321 Dec 15 11:34:07.516295 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-bb13ffc5-3445-4453-8bdf-9da7cfff8205 req-44ede893-0acb-4dea-a2ca-54eb426b0200 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066953 Dec 15 11:34:07.522537 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 268/537] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:34:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:34:07.952425 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-286de1ad-4d32-4945-86ae-89d266d983a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:07.966733 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-286de1ad-4d32-4945-86ae-89d266d983a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1671 microversion: 2.1 time: 0.766798 Dec 15 11:34:07.968400 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 270/538] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:07 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1671 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:08.124884 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8cbbea87-4452-43e5-8fc6-a03d985045b8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:08.125733 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8cbbea87-4452-43e5-8fc6-a03d985045b8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:08.135884 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8cbbea87-4452-43e5-8fc6-a03d985045b8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:08.136346 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8cbbea87-4452-43e5-8fc6-a03d985045b8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:08.144559 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8cbbea87-4452-43e5-8fc6-a03d985045b8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:08.147053 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8cbbea87-4452-43e5-8fc6-a03d985045b8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:08.565752 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8cbbea87-4452-43e5-8fc6-a03d985045b8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:08.578591 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8cbbea87-4452-43e5-8fc6-a03d985045b8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:08.581579 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8cbbea87-4452-43e5-8fc6-a03d985045b8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:08.582998 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8cbbea87-4452-43e5-8fc6-a03d985045b8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1406 microversion: 2.20 time: 0.463041 Dec 15 11:34:08.584045 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 269/539] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:34:08 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:34:08.985020 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c04e59f6-4160-40ff-ba44-bcea77df3687 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:08.985820 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c04e59f6-4160-40ff-ba44-bcea77df3687 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:09.008943 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c04e59f6-4160-40ff-ba44-bcea77df3687 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:09.009560 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c04e59f6-4160-40ff-ba44-bcea77df3687 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:09.010657 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c04e59f6-4160-40ff-ba44-bcea77df3687 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:09.011352 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c04e59f6-4160-40ff-ba44-bcea77df3687 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:09.605691 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c04e59f6-4160-40ff-ba44-bcea77df3687 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:09.607953 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-395df471-05d0-4617-9931-111b1810683a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:09.610350 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-395df471-05d0-4617-9931-111b1810683a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:09.621950 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-395df471-05d0-4617-9931-111b1810683a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:09.624244 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c04e59f6-4160-40ff-ba44-bcea77df3687 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1671 microversion: 2.1 time: 0.643714 Dec 15 11:34:09.625812 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-395df471-05d0-4617-9931-111b1810683a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:09.626238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 271/540] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:08 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1671 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:09.627312 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-395df471-05d0-4617-9931-111b1810683a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:09.627914 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-395df471-05d0-4617-9931-111b1810683a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:09.789996 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-395df471-05d0-4617-9931-111b1810683a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:09.807202 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-395df471-05d0-4617-9931-111b1810683a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:09.811410 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-395df471-05d0-4617-9931-111b1810683a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:09.813829 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-395df471-05d0-4617-9931-111b1810683a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1406 microversion: 2.20 time: 0.215280 Dec 15 11:34:09.831490 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 270/541] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:34:09 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:34:10.625365 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-6496b3e7-0163-48b8-a327-6e7b52d8899d req-64b8db59-5ef3-4474-9842-672284c4b4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ab2164-7f19-4c54-8e4e-91295c45a538", "name": "network-vif-deleted", "tag": "038396f8-c2e8-482c-a9e9-cf23fb211312"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:10.628461 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:34:10.628461 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:34:10.643424 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d2151ba6-3053-45fe-af22-e896e8c26874 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:10.645578 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d2151ba6-3053-45fe-af22-e896e8c26874 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:10.659620 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-6496b3e7-0163-48b8-a327-6e7b52d8899d req-64b8db59-5ef3-4474-9842-672284c4b4f9 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:10.663641 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-6496b3e7-0163-48b8-a327-6e7b52d8899d req-64b8db59-5ef3-4474-9842-672284c4b4f9 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:10.667886 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d2151ba6-3053-45fe-af22-e896e8c26874 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:10.668674 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d2151ba6-3053-45fe-af22-e896e8c26874 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:10.669943 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d2151ba6-3053-45fe-af22-e896e8c26874 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:10.670924 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d2151ba6-3053-45fe-af22-e896e8c26874 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:10.702624 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-6496b3e7-0163-48b8-a327-6e7b52d8899d req-64b8db59-5ef3-4474-9842-672284c4b4f9 service nova] Creating event network-vif-deleted:038396f8-c2e8-482c-a9e9-cf23fb211312 for instance 23ab2164-7f19-4c54-8e4e-91295c45a538 on hv-cinder-81321 Dec 15 11:34:10.713349 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-6496b3e7-0163-48b8-a327-6e7b52d8899d req-64b8db59-5ef3-4474-9842-672284c4b4f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092112 Dec 15 11:34:10.717143 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 272/542] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:34:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:34:10.774648 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d2151ba6-3053-45fe-af22-e896e8c26874 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:10.783952 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d2151ba6-3053-45fe-af22-e896e8c26874 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 200 len: 1321 microversion: 2.1 time: 0.145258 Dec 15 11:34:10.785086 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 271/543] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:10 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:10.844756 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c960d824-f66b-4501-b632-926483b3284e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:10.845744 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c960d824-f66b-4501-b632-926483b3284e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:10.852675 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c960d824-f66b-4501-b632-926483b3284e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:10.853234 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c960d824-f66b-4501-b632-926483b3284e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:10.854844 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c960d824-f66b-4501-b632-926483b3284e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:10.855464 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c960d824-f66b-4501-b632-926483b3284e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:11.099110 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c960d824-f66b-4501-b632-926483b3284e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:11.107824 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c960d824-f66b-4501-b632-926483b3284e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:11.110258 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c960d824-f66b-4501-b632-926483b3284e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:11.111930 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c960d824-f66b-4501-b632-926483b3284e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1406 microversion: 2.20 time: 0.271486 Dec 15 11:34:11.113364 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 273/544] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:34:10 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:34:11.808653 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8398e1d6-8d85-4092-b4ad-c82250eb3f8f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:11.809269 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8398e1d6-8d85-4092-b4ad-c82250eb3f8f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:11.828863 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8398e1d6-8d85-4092-b4ad-c82250eb3f8f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:11.830383 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8398e1d6-8d85-4092-b4ad-c82250eb3f8f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:11.831845 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8398e1d6-8d85-4092-b4ad-c82250eb3f8f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:11.833349 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8398e1d6-8d85-4092-b4ad-c82250eb3f8f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:11.875651 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-8398e1d6-8d85-4092-b4ad-c82250eb3f8f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] HTTP exception thrown: Instance 23ab2164-7f19-4c54-8e4e-91295c45a538 could not be found. Dec 15 11:34:11.876260 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8398e1d6-8d85-4092-b4ad-c82250eb3f8f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Returning 404 to user: Instance 23ab2164-7f19-4c54-8e4e-91295c45a538 could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:34:11.881330 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8398e1d6-8d85-4092-b4ad-c82250eb3f8f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 404 len: 111 microversion: 2.1 time: 0.079361 Dec 15 11:34:11.882846 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 272/545] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:11 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:34:11.894719 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-081be61c-1278-47c6-9c53-7608ae3887b3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '.version_select at 0x7fdf59a1f9d0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:11.935437 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-081be61c-1278-47c6-9c53-7608ae3887b3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-772178173" status: 202 len: 0 microversion: 2.1 time: 0.047747 Dec 15 11:34:11.936036 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 274/546] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Dec 15 11:34:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-772178173 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:12.131878 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6d2764d8-2864-4119-a6ba-f568b153cb3a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:12.132500 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6d2764d8-2864-4119-a6ba-f568b153cb3a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:12.152966 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6d2764d8-2864-4119-a6ba-f568b153cb3a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:12.153420 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6d2764d8-2864-4119-a6ba-f568b153cb3a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:12.154218 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6d2764d8-2864-4119-a6ba-f568b153cb3a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:12.163681 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6d2764d8-2864-4119-a6ba-f568b153cb3a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:12.456713 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6d2764d8-2864-4119-a6ba-f568b153cb3a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:12.469536 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6d2764d8-2864-4119-a6ba-f568b153cb3a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:12.471411 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6d2764d8-2864-4119-a6ba-f568b153cb3a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:12.476537 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6d2764d8-2864-4119-a6ba-f568b153cb3a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1406 microversion: 2.20 time: 0.349634 Dec 15 11:34:12.487602 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 273/547] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:34:12 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:34:12.955528 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-757ca2e1-f270-4f91-a15d-5f206c49881c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'create', calling method: .version_select at 0x7fdf59a85160>, body: {"keypair": {"name": "tempest-keypair-1068316953"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:12.984293 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-757ca2e1-f270-4f91-a15d-5f206c49881c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:34:12.990496 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-757ca2e1-f270-4f91-a15d-5f206c49881c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for user 9d42a79896b0419e8ea94d7cb7f23d4e and project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:34:13.173267 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-757ca2e1-f270-4f91-a15d-5f206c49881c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:34:13.177543 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-757ca2e1-f270-4f91-a15d-5f206c49881c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for user 9d42a79896b0419e8ea94d7cb7f23d4e and project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:34:13.202299 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-757ca2e1-f270-4f91-a15d-5f206c49881c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.252678 Dec 15 11:34:13.209674 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 275/548] 10.222.0.18 () {60 vars in 1157 bytes} [Wed Dec 15 11:34:12 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:13.301012 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-c4025a28-9af1-4806-982e-b53c8245de94 req-e8a23444-d0af-418c-aeb4-fd9d6fe2df6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc1474a-92ec-418e-9cd4-3f10cf91c8bd", "name": "network-vif-plugged", "status": "completed", "tag": "6c0ef6e9-6255-460a-8ffb-7e490afe7546"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:13.307338 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:34:13.307338 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:34:13.327400 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-c4025a28-9af1-4806-982e-b53c8245de94 req-e8a23444-d0af-418c-aeb4-fd9d6fe2df6f service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:13.329915 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-c4025a28-9af1-4806-982e-b53c8245de94 req-e8a23444-d0af-418c-aeb4-fd9d6fe2df6f service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:13.355755 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-c4025a28-9af1-4806-982e-b53c8245de94 req-e8a23444-d0af-418c-aeb4-fd9d6fe2df6f service nova] Creating event network-vif-plugged:6c0ef6e9-6255-460a-8ffb-7e490afe7546 for instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd on hv-cinder-81321 Dec 15 11:34:13.369460 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-c4025a28-9af1-4806-982e-b53c8245de94 req-e8a23444-d0af-418c-aeb4-fd9d6fe2df6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074609 Dec 15 11:34:13.370546 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 274/549] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:34:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:34:13.492167 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-54f636f0-7b75-4ca0-9d7d-b7300fe3e06f tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:13.493215 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-54f636f0-7b75-4ca0-9d7d-b7300fe3e06f tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:13.505876 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-54f636f0-7b75-4ca0-9d7d-b7300fe3e06f tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:13.508799 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-54f636f0-7b75-4ca0-9d7d-b7300fe3e06f tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:13.509654 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-54f636f0-7b75-4ca0-9d7d-b7300fe3e06f tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:13.510101 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-54f636f0-7b75-4ca0-9d7d-b7300fe3e06f tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:13.591974 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-54f636f0-7b75-4ca0-9d7d-b7300fe3e06f tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "POST /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/action" status: 202 len: 0 microversion: 2.1 time: 0.105683 Dec 15 11:34:13.593670 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 275/550] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:13 2021] POST /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:13.601111 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-08efc445-9c04-457d-a67f-e7144c167454 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:13.602060 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-08efc445-9c04-457d-a67f-e7144c167454 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:13.610092 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-08efc445-9c04-457d-a67f-e7144c167454 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:13.611143 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-08efc445-9c04-457d-a67f-e7144c167454 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:13.612309 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-08efc445-9c04-457d-a67f-e7144c167454 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:13.613065 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-08efc445-9c04-457d-a67f-e7144c167454 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:13.684638 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-67bb2933-da72-433d-ba68-dc5f4b31fc09 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Action: 'create', calling method: .version_select at 0x7fdf59a17160>, body: {"keypair": {"name": "tempest-TestShelveInstance-199429054"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:13.712985 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-67bb2933-da72-433d-ba68-dc5f4b31fc09 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Getting quotas for project c33910c71a6444d4a48fe8455c0736d5. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:34:13.717465 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-67bb2933-da72-433d-ba68-dc5f4b31fc09 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Getting quotas for user 9f3d4afb45294feb8c7f61d0abfd1334 and project c33910c71a6444d4a48fe8455c0736d5. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:34:13.828150 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-08efc445-9c04-457d-a67f-e7144c167454 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:13.837765 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-08efc445-9c04-457d-a67f-e7144c167454 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:13.839661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-08efc445-9c04-457d-a67f-e7144c167454 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:13.841286 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-08efc445-9c04-457d-a67f-e7144c167454 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1406 microversion: 2.20 time: 0.246364 Dec 15 11:34:13.841940 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 276/551] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:34:13 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:34:13.846501 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e41f4cf3-0e20-4b8b-9ff8-1679443304e9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:13.847297 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e41f4cf3-0e20-4b8b-9ff8-1679443304e9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:13.853775 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e41f4cf3-0e20-4b8b-9ff8-1679443304e9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:13.854319 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e41f4cf3-0e20-4b8b-9ff8-1679443304e9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:13.855521 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e41f4cf3-0e20-4b8b-9ff8-1679443304e9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:13.856181 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e41f4cf3-0e20-4b8b-9ff8-1679443304e9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:13.865635 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-67bb2933-da72-433d-ba68-dc5f4b31fc09 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Getting quotas for project c33910c71a6444d4a48fe8455c0736d5. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:34:13.869926 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-67bb2933-da72-433d-ba68-dc5f4b31fc09 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Getting quotas for user 9f3d4afb45294feb8c7f61d0abfd1334 and project c33910c71a6444d4a48fe8455c0736d5. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:34:13.886411 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-67bb2933-da72-433d-ba68-dc5f4b31fc09 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.536891 Dec 15 11:34:13.891471 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 276/552] 10.222.0.18 () {60 vars in 1157 bytes} [Wed Dec 15 11:34:13 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:14.028196 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e41f4cf3-0e20-4b8b-9ff8-1679443304e9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:14.040365 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e41f4cf3-0e20-4b8b-9ff8-1679443304e9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1749 microversion: 2.1 time: 0.197088 Dec 15 11:34:14.041339 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 277/553] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:13 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1749 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:14.863127 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ca39a464-5903-4b8b-abf8-64b9969903c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:14.865893 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ca39a464-5903-4b8b-abf8-64b9969903c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:14.876939 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca39a464-5903-4b8b-abf8-64b9969903c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:14.878551 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca39a464-5903-4b8b-abf8-64b9969903c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:14.880599 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca39a464-5903-4b8b-abf8-64b9969903c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:14.881251 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca39a464-5903-4b8b-abf8-64b9969903c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:15.060261 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8c57fab8-951d-4c55-af91-97546e5a46d3 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:15.061528 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8c57fab8-951d-4c55-af91-97546e5a46d3 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:15.073890 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8c57fab8-951d-4c55-af91-97546e5a46d3 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:15.074354 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8c57fab8-951d-4c55-af91-97546e5a46d3 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:15.075221 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8c57fab8-951d-4c55-af91-97546e5a46d3 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:15.080785 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8c57fab8-951d-4c55-af91-97546e5a46d3 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:15.153383 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ca39a464-5903-4b8b-abf8-64b9969903c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:15.163740 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ca39a464-5903-4b8b-abf8-64b9969903c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:15.165405 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ca39a464-5903-4b8b-abf8-64b9969903c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:15.166686 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ca39a464-5903-4b8b-abf8-64b9969903c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1597 microversion: 2.20 time: 0.310324 Dec 15 11:34:15.167494 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 277/554] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:34:14 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1597 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:34:15.191488 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2db2ab89-1284-4037-82dc-517522141425 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:15.191840 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2db2ab89-1284-4037-82dc-517522141425 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:15.199770 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2db2ab89-1284-4037-82dc-517522141425 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:15.201030 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2db2ab89-1284-4037-82dc-517522141425 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:15.202045 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2db2ab89-1284-4037-82dc-517522141425 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:15.202490 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2db2ab89-1284-4037-82dc-517522141425 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:15.338831 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8c57fab8-951d-4c55-af91-97546e5a46d3 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:15.349401 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8c57fab8-951d-4c55-af91-97546e5a46d3 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1754 microversion: 2.1 time: 0.294098 Dec 15 11:34:15.350663 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 278/555] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:15 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1754 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:15.389291 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2db2ab89-1284-4037-82dc-517522141425 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.205804 Dec 15 11:34:15.390693 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 278/556] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Dec 15 11:34:15 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:15.704938 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-798540731", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96f54107-e4ae-490e-bbe4-76ba51e710b8"}], "security_groups": [{"name": "tempest-securitygroup--1451687603"}], "key_name": "tempest-keypair-1068316953", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:15.951797 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.network.neutron [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] validate_networks() for [('96f54107-e4ae-490e-bbe4-76ba51e710b8', None, None, None, None, None)] {{(pid=116082) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:34:16.368522 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c28c6ff0-1c97-466d-9ca2-359e6a3c7c31 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:16.369718 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c28c6ff0-1c97-466d-9ca2-359e6a3c7c31 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:16.381379 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c28c6ff0-1c97-466d-9ca2-359e6a3c7c31 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:16.383703 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c28c6ff0-1c97-466d-9ca2-359e6a3c7c31 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:16.386157 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c28c6ff0-1c97-466d-9ca2-359e6a3c7c31 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:16.388212 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c28c6ff0-1c97-466d-9ca2-359e6a3c7c31 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:16.580102 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c28c6ff0-1c97-466d-9ca2-359e6a3c7c31 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:16.590923 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c28c6ff0-1c97-466d-9ca2-359e6a3c7c31 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1754 microversion: 2.1 time: 0.225993 Dec 15 11:34:16.597280 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 279/557] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:16 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1754 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:16.783467 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Flavor limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:34:16.783959 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Image limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:34:16.784552 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Flavor pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:34:16.784969 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Image pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:34:16.786216 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:34:16.797395 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:16.797957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:16.798798 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:16.799228 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:16.823433 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:34:16.828897 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Getting quotas for user 9d42a79896b0419e8ea94d7cb7f23d4e and project e54b7fea367f4c6e9a7012b3cc94e56e. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:34:16.847639 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Going to run 1 instances... {{(pid=116082) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:34:16.850929 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116082) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:34:16.906133 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b87944fc-63be-4c0e-9535-b8929cd606c7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.209544 Dec 15 11:34:16.907539 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 279/558] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:34:15 2021] POST /compute/v2.1/servers => generated 402 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:34:16.918132 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9a15b98f-cc62-4971-9a7a-94fd4869f937 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:16.919097 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9a15b98f-cc62-4971-9a7a-94fd4869f937 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:17.030354 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9a15b98f-cc62-4971-9a7a-94fd4869f937 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:17.038733 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9a15b98f-cc62-4971-9a7a-94fd4869f937 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1237 microversion: 2.1 time: 0.124568 Dec 15 11:34:17.043169 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 280/559] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:16 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1237 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:17.236762 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-b2176196-901e-4492-a3d3-9d332b316ae4 req-23e588cd-7d28-49be-b86d-147a48bc6f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc1474a-92ec-418e-9cd4-3f10cf91c8bd", "tag": "6c0ef6e9-6255-460a-8ffb-7e490afe7546"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:17.240471 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-af9e32d7-5c11-424a-9144-e04463692d9f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:17.241629 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:34:17.241629 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:34:17.242634 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-af9e32d7-5c11-424a-9144-e04463692d9f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:17.252269 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-b2176196-901e-4492-a3d3-9d332b316ae4 req-23e588cd-7d28-49be-b86d-147a48bc6f61 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:17.252976 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-b2176196-901e-4492-a3d3-9d332b316ae4 req-23e588cd-7d28-49be-b86d-147a48bc6f61 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:17.267468 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-b2176196-901e-4492-a3d3-9d332b316ae4 req-23e588cd-7d28-49be-b86d-147a48bc6f61 service nova] Creating event network-changed:6c0ef6e9-6255-460a-8ffb-7e490afe7546 for instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd on hv-cinder-81321 Dec 15 11:34:17.268162 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-af9e32d7-5c11-424a-9144-e04463692d9f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:17.268818 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-af9e32d7-5c11-424a-9144-e04463692d9f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:17.269844 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-af9e32d7-5c11-424a-9144-e04463692d9f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:17.270523 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-af9e32d7-5c11-424a-9144-e04463692d9f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:17.273067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-b2176196-901e-4492-a3d3-9d332b316ae4 req-23e588cd-7d28-49be-b86d-147a48bc6f61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043264 Dec 15 11:34:17.273641 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 281/560] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:34:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:34:17.342324 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-af9e32d7-5c11-424a-9144-e04463692d9f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14 microversion: 2.20 time: 0.114205 Dec 15 11:34:17.343017 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 280/561] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:17 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:17.618942 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2cf56bf1-863e-47fc-aa6a-8c902e68b5bf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:17.620303 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2cf56bf1-863e-47fc-aa6a-8c902e68b5bf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:17.631545 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cf56bf1-863e-47fc-aa6a-8c902e68b5bf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:17.634086 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cf56bf1-863e-47fc-aa6a-8c902e68b5bf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:17.635080 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cf56bf1-863e-47fc-aa6a-8c902e68b5bf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:17.635648 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cf56bf1-863e-47fc-aa6a-8c902e68b5bf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:17.893099 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2cf56bf1-863e-47fc-aa6a-8c902e68b5bf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:17.902049 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2cf56bf1-863e-47fc-aa6a-8c902e68b5bf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1754 microversion: 2.1 time: 0.288597 Dec 15 11:34:17.902667 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 282/562] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:17 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1754 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:18.080821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-365d37bc-47fe-4652-a77a-2973ca1f4ee3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:18.082588 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-365d37bc-47fe-4652-a77a-2973ca1f4ee3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:18.091228 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-365d37bc-47fe-4652-a77a-2973ca1f4ee3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:18.091939 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-365d37bc-47fe-4652-a77a-2973ca1f4ee3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:18.093247 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-365d37bc-47fe-4652-a77a-2973ca1f4ee3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:18.093852 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-365d37bc-47fe-4652-a77a-2973ca1f4ee3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:18.173253 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-365d37bc-47fe-4652-a77a-2973ca1f4ee3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:18.183608 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-365d37bc-47fe-4652-a77a-2973ca1f4ee3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1297 microversion: 2.1 time: 0.123385 Dec 15 11:34:18.184593 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 281/563] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:18 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:18.357520 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b239042a-cc57-4f2b-bafe-f29cae96cbd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:18.358594 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b239042a-cc57-4f2b-bafe-f29cae96cbd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:18.367813 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b239042a-cc57-4f2b-bafe-f29cae96cbd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:18.368267 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b239042a-cc57-4f2b-bafe-f29cae96cbd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:18.369208 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b239042a-cc57-4f2b-bafe-f29cae96cbd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:18.369656 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b239042a-cc57-4f2b-bafe-f29cae96cbd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:18.447345 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b239042a-cc57-4f2b-bafe-f29cae96cbd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14 microversion: 2.20 time: 0.095543 Dec 15 11:34:18.447977 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 283/564] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:18 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:18.919199 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fdbdb6fe-14b5-41e9-9ebc-e8fca7363450 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:18.920053 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fdbdb6fe-14b5-41e9-9ebc-e8fca7363450 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:18.935924 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fdbdb6fe-14b5-41e9-9ebc-e8fca7363450 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:18.936476 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fdbdb6fe-14b5-41e9-9ebc-e8fca7363450 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:18.937447 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fdbdb6fe-14b5-41e9-9ebc-e8fca7363450 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:18.937945 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fdbdb6fe-14b5-41e9-9ebc-e8fca7363450 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:19.101159 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fdbdb6fe-14b5-41e9-9ebc-e8fca7363450 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:19.109051 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fdbdb6fe-14b5-41e9-9ebc-e8fca7363450 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1754 microversion: 2.1 time: 0.193584 Dec 15 11:34:19.109528 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 282/565] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:18 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:19.206443 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-31edf843-1a1c-4120-ad5b-89751dff8a01 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:19.207288 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-31edf843-1a1c-4120-ad5b-89751dff8a01 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:19.215681 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-31edf843-1a1c-4120-ad5b-89751dff8a01 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:19.216531 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-31edf843-1a1c-4120-ad5b-89751dff8a01 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:19.217398 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-31edf843-1a1c-4120-ad5b-89751dff8a01 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:19.217903 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-31edf843-1a1c-4120-ad5b-89751dff8a01 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:19.457180 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-32968f0c-8e75-4226-af58-85255fc62802 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:19.458839 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-32968f0c-8e75-4226-af58-85255fc62802 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:19.464997 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-32968f0c-8e75-4226-af58-85255fc62802 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:19.465440 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-32968f0c-8e75-4226-af58-85255fc62802 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:19.466479 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-32968f0c-8e75-4226-af58-85255fc62802 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:19.466946 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-32968f0c-8e75-4226-af58-85255fc62802 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:19.517424 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-31edf843-1a1c-4120-ad5b-89751dff8a01 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:19.527831 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-31edf843-1a1c-4120-ad5b-89751dff8a01 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1363 microversion: 2.1 time: 0.326145 Dec 15 11:34:19.528532 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 284/566] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:19 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:19.534831 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-32968f0c-8e75-4226-af58-85255fc62802 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14 microversion: 2.20 time: 0.081094 Dec 15 11:34:19.535555 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 283/567] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:19 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:19.868909 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-1880a107-b8d0-4ecd-b520-f96b6620ce12 req-2c4f7d0b-1db0-4256-a8e6-c89d190e3ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52997851-a1cb-48b6-b627-5e8c3f3353d1", "tag": "82833ca8-8969-4cc7-8f34-e7c18fd7e1c3"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:19.870935 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:34:19.870935 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:34:19.884397 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1880a107-b8d0-4ecd-b520-f96b6620ce12 req-2c4f7d0b-1db0-4256-a8e6-c89d190e3ef7 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:19.885060 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1880a107-b8d0-4ecd-b520-f96b6620ce12 req-2c4f7d0b-1db0-4256-a8e6-c89d190e3ef7 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:19.904736 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-1880a107-b8d0-4ecd-b520-f96b6620ce12 req-2c4f7d0b-1db0-4256-a8e6-c89d190e3ef7 service nova] Creating event network-changed:82833ca8-8969-4cc7-8f34-e7c18fd7e1c3 for instance 52997851-a1cb-48b6-b627-5e8c3f3353d1 on hv-cinder-81321 Dec 15 11:34:19.909845 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-1880a107-b8d0-4ecd-b520-f96b6620ce12 req-2c4f7d0b-1db0-4256-a8e6-c89d190e3ef7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045735 Dec 15 11:34:19.910653 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 285/568] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:34:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:34:20.127439 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4527b48e-572d-42f4-a8d9-5f046b76bedd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:20.128151 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4527b48e-572d-42f4-a8d9-5f046b76bedd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:20.135749 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4527b48e-572d-42f4-a8d9-5f046b76bedd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:20.136203 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4527b48e-572d-42f4-a8d9-5f046b76bedd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:20.136993 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4527b48e-572d-42f4-a8d9-5f046b76bedd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:20.137431 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4527b48e-572d-42f4-a8d9-5f046b76bedd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:20.286217 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4527b48e-572d-42f4-a8d9-5f046b76bedd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:20.294007 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4527b48e-572d-42f4-a8d9-5f046b76bedd tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1754 microversion: 2.1 time: 0.170890 Dec 15 11:34:20.294593 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 284/569] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:20 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:20.546689 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-28ad0728-0ab6-4cb0-8d3c-9c47ed461409 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:20.551793 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-aea234d7-667a-4b9d-956f-2ee43d3d3cd8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:20.552424 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-aea234d7-667a-4b9d-956f-2ee43d3d3cd8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:20.556559 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-28ad0728-0ab6-4cb0-8d3c-9c47ed461409 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:20.559184 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-aea234d7-667a-4b9d-956f-2ee43d3d3cd8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:20.559863 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-aea234d7-667a-4b9d-956f-2ee43d3d3cd8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:20.560644 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-aea234d7-667a-4b9d-956f-2ee43d3d3cd8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:20.561066 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-aea234d7-667a-4b9d-956f-2ee43d3d3cd8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:20.562771 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28ad0728-0ab6-4cb0-8d3c-9c47ed461409 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:20.563218 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28ad0728-0ab6-4cb0-8d3c-9c47ed461409 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:20.563991 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28ad0728-0ab6-4cb0-8d3c-9c47ed461409 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:20.564594 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28ad0728-0ab6-4cb0-8d3c-9c47ed461409 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:20.638830 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-28ad0728-0ab6-4cb0-8d3c-9c47ed461409 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14 microversion: 2.20 time: 0.096521 Dec 15 11:34:20.639461 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 286/570] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:20 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:20.696148 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-aea234d7-667a-4b9d-956f-2ee43d3d3cd8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:20.703536 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-aea234d7-667a-4b9d-956f-2ee43d3d3cd8 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1363 microversion: 2.1 time: 0.155376 Dec 15 11:34:20.704170 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 285/571] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:20 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:21.312798 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e48f2bbf-6f20-4ee5-b199-fc66bf626abe tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:21.313419 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e48f2bbf-6f20-4ee5-b199-fc66bf626abe tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:21.320969 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e48f2bbf-6f20-4ee5-b199-fc66bf626abe tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:21.321414 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e48f2bbf-6f20-4ee5-b199-fc66bf626abe tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:21.322184 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e48f2bbf-6f20-4ee5-b199-fc66bf626abe tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:21.322649 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e48f2bbf-6f20-4ee5-b199-fc66bf626abe tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:21.465114 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e48f2bbf-6f20-4ee5-b199-fc66bf626abe tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:21.473533 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e48f2bbf-6f20-4ee5-b199-fc66bf626abe tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1754 microversion: 2.1 time: 0.165108 Dec 15 11:34:21.474415 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 287/572] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:21 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:21.649394 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c27013a9-9f77-4205-b211-da5689aa7f6a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:21.650295 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c27013a9-9f77-4205-b211-da5689aa7f6a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:21.656565 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c27013a9-9f77-4205-b211-da5689aa7f6a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:21.657013 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c27013a9-9f77-4205-b211-da5689aa7f6a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:21.657782 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c27013a9-9f77-4205-b211-da5689aa7f6a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:21.658214 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c27013a9-9f77-4205-b211-da5689aa7f6a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:21.720890 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9f42b6be-3494-4ae3-87c8-db34e0b0f333 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:21.721507 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9f42b6be-3494-4ae3-87c8-db34e0b0f333 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:21.727260 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c27013a9-9f77-4205-b211-da5689aa7f6a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14 microversion: 2.20 time: 0.081494 Dec 15 11:34:21.728009 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 286/573] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:21 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:21.729314 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f42b6be-3494-4ae3-87c8-db34e0b0f333 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:21.729764 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f42b6be-3494-4ae3-87c8-db34e0b0f333 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:21.730556 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f42b6be-3494-4ae3-87c8-db34e0b0f333 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:21.731017 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f42b6be-3494-4ae3-87c8-db34e0b0f333 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:21.867442 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9f42b6be-3494-4ae3-87c8-db34e0b0f333 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:21.874527 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9f42b6be-3494-4ae3-87c8-db34e0b0f333 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1363 microversion: 2.1 time: 0.157253 Dec 15 11:34:21.875123 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 288/574] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:21 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:22.491544 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e5800c31-bdaf-44b3-8126-b209c6217c6b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:22.492246 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e5800c31-bdaf-44b3-8126-b209c6217c6b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:22.499217 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e5800c31-bdaf-44b3-8126-b209c6217c6b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:22.499668 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e5800c31-bdaf-44b3-8126-b209c6217c6b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:22.500445 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e5800c31-bdaf-44b3-8126-b209c6217c6b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:22.500881 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e5800c31-bdaf-44b3-8126-b209c6217c6b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:22.651945 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e5800c31-bdaf-44b3-8126-b209c6217c6b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:22.659590 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e5800c31-bdaf-44b3-8126-b209c6217c6b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1754 microversion: 2.1 time: 0.172178 Dec 15 11:34:22.660153 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 287/575] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:22 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:22.737377 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c6644472-f5de-431a-a728-dada2296858d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:22.738294 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c6644472-f5de-431a-a728-dada2296858d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:22.745363 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6644472-f5de-431a-a728-dada2296858d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:22.745751 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6644472-f5de-431a-a728-dada2296858d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:22.746528 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6644472-f5de-431a-a728-dada2296858d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:22.746989 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c6644472-f5de-431a-a728-dada2296858d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:22.804665 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c6644472-f5de-431a-a728-dada2296858d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14 microversion: 2.20 time: 0.070843 Dec 15 11:34:22.805295 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 289/576] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:22 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:22.890328 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3730bc47-1957-4d6c-9978-ae50af52fce0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:22.890962 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3730bc47-1957-4d6c-9978-ae50af52fce0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:22.897570 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3730bc47-1957-4d6c-9978-ae50af52fce0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:22.898019 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3730bc47-1957-4d6c-9978-ae50af52fce0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:22.898818 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3730bc47-1957-4d6c-9978-ae50af52fce0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:22.899256 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3730bc47-1957-4d6c-9978-ae50af52fce0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:23.027305 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-3730bc47-1957-4d6c-9978-ae50af52fce0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:23.034381 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3730bc47-1957-4d6c-9978-ae50af52fce0 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1363 microversion: 2.1 time: 0.147773 Dec 15 11:34:23.034975 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 288/577] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:22 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:23.677752 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-06b047e6-91c6-40ae-b52f-d7fbc8ce76cf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:23.678771 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-06b047e6-91c6-40ae-b52f-d7fbc8ce76cf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:23.685972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-06b047e6-91c6-40ae-b52f-d7fbc8ce76cf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:23.686417 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-06b047e6-91c6-40ae-b52f-d7fbc8ce76cf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:23.687241 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-06b047e6-91c6-40ae-b52f-d7fbc8ce76cf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:23.687673 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-06b047e6-91c6-40ae-b52f-d7fbc8ce76cf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:23.815537 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0e611850-82cd-47ba-b5e8-cb442f947730 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:23.816428 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-0e611850-82cd-47ba-b5e8-cb442f947730 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:23.823245 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0e611850-82cd-47ba-b5e8-cb442f947730 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:23.823700 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0e611850-82cd-47ba-b5e8-cb442f947730 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:23.824482 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0e611850-82cd-47ba-b5e8-cb442f947730 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:23.824916 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0e611850-82cd-47ba-b5e8-cb442f947730 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:23.840191 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-06b047e6-91c6-40ae-b52f-d7fbc8ce76cf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:23.848303 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-06b047e6-91c6-40ae-b52f-d7fbc8ce76cf tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1754 microversion: 2.1 time: 0.174803 Dec 15 11:34:23.848881 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 290/578] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:23 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:23.882056 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0e611850-82cd-47ba-b5e8-cb442f947730 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14 microversion: 2.20 time: 0.070138 Dec 15 11:34:23.882807 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 289/579] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:23 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:24.052108 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4c4867c2-47de-4593-a74a-2df0a196c533 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:24.052725 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4c4867c2-47de-4593-a74a-2df0a196c533 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:24.059007 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4c4867c2-47de-4593-a74a-2df0a196c533 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:24.059454 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4c4867c2-47de-4593-a74a-2df0a196c533 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:24.060231 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4c4867c2-47de-4593-a74a-2df0a196c533 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:24.060666 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4c4867c2-47de-4593-a74a-2df0a196c533 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:24.195384 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4c4867c2-47de-4593-a74a-2df0a196c533 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:24.202535 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4c4867c2-47de-4593-a74a-2df0a196c533 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1363 microversion: 2.1 time: 0.154458 Dec 15 11:34:24.203135 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 291/580] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:24 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:24.866116 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e241d835-039e-4745-b1bc-fd49ea559ac9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:24.866851 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e241d835-039e-4745-b1bc-fd49ea559ac9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:24.874072 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e241d835-039e-4745-b1bc-fd49ea559ac9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:24.874518 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e241d835-039e-4745-b1bc-fd49ea559ac9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:24.875346 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e241d835-039e-4745-b1bc-fd49ea559ac9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:24.875770 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e241d835-039e-4745-b1bc-fd49ea559ac9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:24.893467 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-83d25a31-1cc4-4d27-83b4-1d062b1fc905 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:24.894308 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-83d25a31-1cc4-4d27-83b4-1d062b1fc905 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:24.901321 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83d25a31-1cc4-4d27-83b4-1d062b1fc905 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:24.901782 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83d25a31-1cc4-4d27-83b4-1d062b1fc905 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:24.902594 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83d25a31-1cc4-4d27-83b4-1d062b1fc905 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:24.903034 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83d25a31-1cc4-4d27-83b4-1d062b1fc905 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:24.963256 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-83d25a31-1cc4-4d27-83b4-1d062b1fc905 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14 microversion: 2.20 time: 0.073413 Dec 15 11:34:24.966529 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 292/581] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:24 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:25.027512 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e241d835-039e-4745-b1bc-fd49ea559ac9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:25.035267 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e241d835-039e-4745-b1bc-fd49ea559ac9 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1754 microversion: 2.1 time: 0.173796 Dec 15 11:34:25.035910 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 290/582] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:24 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:25.220630 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-22c168fd-a820-4e5a-909e-d1b767c7f27c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:25.221320 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-22c168fd-a820-4e5a-909e-d1b767c7f27c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:25.228845 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22c168fd-a820-4e5a-909e-d1b767c7f27c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:25.229294 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22c168fd-a820-4e5a-909e-d1b767c7f27c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:25.230065 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22c168fd-a820-4e5a-909e-d1b767c7f27c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:25.230491 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22c168fd-a820-4e5a-909e-d1b767c7f27c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:25.331478 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-e5dbf562-7e5c-4fcc-8a4c-4a2f515a32c9 req-638b5b56-4621-4c7e-8406-258609499fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52997851-a1cb-48b6-b627-5e8c3f3353d1", "name": "network-vif-plugged", "status": "completed", "tag": "82833ca8-8969-4cc7-8f34-e7c18fd7e1c3"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:25.333926 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:34:25.333926 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:34:25.341967 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-e5dbf562-7e5c-4fcc-8a4c-4a2f515a32c9 req-638b5b56-4621-4c7e-8406-258609499fe5 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:25.342391 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-e5dbf562-7e5c-4fcc-8a4c-4a2f515a32c9 req-638b5b56-4621-4c7e-8406-258609499fe5 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:25.356014 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-e5dbf562-7e5c-4fcc-8a4c-4a2f515a32c9 req-638b5b56-4621-4c7e-8406-258609499fe5 service nova] Creating event network-vif-plugged:82833ca8-8969-4cc7-8f34-e7c18fd7e1c3 for instance 52997851-a1cb-48b6-b627-5e8c3f3353d1 on hv-cinder-81321 Dec 15 11:34:25.361015 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-e5dbf562-7e5c-4fcc-8a4c-4a2f515a32c9 req-638b5b56-4621-4c7e-8406-258609499fe5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033099 Dec 15 11:34:25.361663 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 291/583] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:34:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:34:25.392659 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-22c168fd-a820-4e5a-909e-d1b767c7f27c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:25.402984 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-22c168fd-a820-4e5a-909e-d1b767c7f27c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1363 microversion: 2.1 time: 0.186504 Dec 15 11:34:25.403558 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 293/584] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:25 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:25.976431 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a5173c41-4afc-407c-bbf0-aedd9a7c4d90 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:25.977553 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a5173c41-4afc-407c-bbf0-aedd9a7c4d90 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:25.984908 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5173c41-4afc-407c-bbf0-aedd9a7c4d90 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:25.985364 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5173c41-4afc-407c-bbf0-aedd9a7c4d90 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:25.986172 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5173c41-4afc-407c-bbf0-aedd9a7c4d90 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:25.986900 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5173c41-4afc-407c-bbf0-aedd9a7c4d90 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:26.053327 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a5173c41-4afc-407c-bbf0-aedd9a7c4d90 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14 microversion: 2.20 time: 0.081707 Dec 15 11:34:26.053647 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-01456602-1bdb-415b-919a-d7f306258e4a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:26.054114 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 292/585] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:25 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:26.054266 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-01456602-1bdb-415b-919a-d7f306258e4a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:26.060592 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01456602-1bdb-415b-919a-d7f306258e4a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:26.061039 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01456602-1bdb-415b-919a-d7f306258e4a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:26.061823 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01456602-1bdb-415b-919a-d7f306258e4a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:26.062262 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01456602-1bdb-415b-919a-d7f306258e4a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:26.212596 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-01456602-1bdb-415b-919a-d7f306258e4a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:26.220835 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-01456602-1bdb-415b-919a-d7f306258e4a tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1757 microversion: 2.1 time: 0.171547 Dec 15 11:34:26.221391 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 294/586] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:26 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:26.421646 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b51d8421-9a29-4c40-a21c-bb0560c13a9b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:26.422372 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b51d8421-9a29-4c40-a21c-bb0560c13a9b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:26.430898 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b51d8421-9a29-4c40-a21c-bb0560c13a9b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:26.431344 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b51d8421-9a29-4c40-a21c-bb0560c13a9b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:26.432115 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b51d8421-9a29-4c40-a21c-bb0560c13a9b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:26.432547 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b51d8421-9a29-4c40-a21c-bb0560c13a9b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:26.572019 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b51d8421-9a29-4c40-a21c-bb0560c13a9b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:26.582644 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b51d8421-9a29-4c40-a21c-bb0560c13a9b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1363 microversion: 2.1 time: 0.165997 Dec 15 11:34:26.583792 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 293/587] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:26 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:27.063578 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f86762f8-eec8-4477-8519-9cbae25b769b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:27.064494 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f86762f8-eec8-4477-8519-9cbae25b769b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:27.071376 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f86762f8-eec8-4477-8519-9cbae25b769b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:27.071851 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f86762f8-eec8-4477-8519-9cbae25b769b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:27.072626 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f86762f8-eec8-4477-8519-9cbae25b769b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:27.073058 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f86762f8-eec8-4477-8519-9cbae25b769b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:27.136747 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f86762f8-eec8-4477-8519-9cbae25b769b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14 microversion: 2.20 time: 0.076689 Dec 15 11:34:27.137408 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 295/588] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:27 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:27.600659 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e778a175-7eb2-4a56-923c-41ef377bd6fe tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:27.601190 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e778a175-7eb2-4a56-923c-41ef377bd6fe tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:27.607385 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e778a175-7eb2-4a56-923c-41ef377bd6fe tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:27.607831 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e778a175-7eb2-4a56-923c-41ef377bd6fe tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:27.608599 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e778a175-7eb2-4a56-923c-41ef377bd6fe tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:27.609036 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e778a175-7eb2-4a56-923c-41ef377bd6fe tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:27.748050 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e778a175-7eb2-4a56-923c-41ef377bd6fe tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:27.758622 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e778a175-7eb2-4a56-923c-41ef377bd6fe tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1550 microversion: 2.1 time: 0.162091 Dec 15 11:34:27.759183 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 294/589] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:27 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:27.774929 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e5221e30-b07d-47ff-870f-88f01a36422c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:27.775509 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e5221e30-b07d-47ff-870f-88f01a36422c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:27.782132 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5221e30-b07d-47ff-870f-88f01a36422c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:27.782560 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5221e30-b07d-47ff-870f-88f01a36422c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:27.783364 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5221e30-b07d-47ff-870f-88f01a36422c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:27.783795 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5221e30-b07d-47ff-870f-88f01a36422c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:27.871543 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e5221e30-b07d-47ff-870f-88f01a36422c tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100574 Dec 15 11:34:27.872174 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 296/590] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Dec 15 11:34:27 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:34:28.148957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e95106b2-f32b-4cf7-9174-d5d45dfe2d67 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:28.149933 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e95106b2-f32b-4cf7-9174-d5d45dfe2d67 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:28.156524 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e95106b2-f32b-4cf7-9174-d5d45dfe2d67 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:28.156941 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e95106b2-f32b-4cf7-9174-d5d45dfe2d67 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:28.157774 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e95106b2-f32b-4cf7-9174-d5d45dfe2d67 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:28.158211 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e95106b2-f32b-4cf7-9174-d5d45dfe2d67 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:28.219694 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e95106b2-f32b-4cf7-9174-d5d45dfe2d67 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14 microversion: 2.20 time: 0.075176 Dec 15 11:34:28.222813 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 295/591] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:28 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:28.844426 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-94c62efe-ec22-4fbe-b812-0d931db1ecad req-b53e5112-9e2f-42a9-9fa7-1c811712f5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52997851-a1cb-48b6-b627-5e8c3f3353d1", "tag": "82833ca8-8969-4cc7-8f34-e7c18fd7e1c3"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:28.845055 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-91e7a397-c4ad-472f-be42-d1e795f69235 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:28.845724 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-91e7a397-c4ad-472f-be42-d1e795f69235 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:28.845925 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:34:28.845925 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:34:28.853362 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91e7a397-c4ad-472f-be42-d1e795f69235 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:28.853814 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91e7a397-c4ad-472f-be42-d1e795f69235 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:28.854388 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-94c62efe-ec22-4fbe-b812-0d931db1ecad req-b53e5112-9e2f-42a9-9fa7-1c811712f5b5 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:28.854599 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91e7a397-c4ad-472f-be42-d1e795f69235 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:28.854861 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-94c62efe-ec22-4fbe-b812-0d931db1ecad req-b53e5112-9e2f-42a9-9fa7-1c811712f5b5 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:28.861116 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91e7a397-c4ad-472f-be42-d1e795f69235 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:28.867963 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-94c62efe-ec22-4fbe-b812-0d931db1ecad req-b53e5112-9e2f-42a9-9fa7-1c811712f5b5 service nova] Creating event network-changed:82833ca8-8969-4cc7-8f34-e7c18fd7e1c3 for instance 52997851-a1cb-48b6-b627-5e8c3f3353d1 on hv-cinder-81321 Dec 15 11:34:28.873558 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-94c62efe-ec22-4fbe-b812-0d931db1ecad req-b53e5112-9e2f-42a9-9fa7-1c811712f5b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033333 Dec 15 11:34:28.874163 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 296/592] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:34:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:34:28.929292 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-91e7a397-c4ad-472f-be42-d1e795f69235 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 14 microversion: 2.1 time: 0.089272 Dec 15 11:34:28.932696 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 297/593] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:28 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:34:29.231422 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-33422f7d-9445-4188-9036-5e7f7e3a8550 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:29.232795 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-33422f7d-9445-4188-9036-5e7f7e3a8550 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:29.238883 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-33422f7d-9445-4188-9036-5e7f7e3a8550 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:29.239959 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-33422f7d-9445-4188-9036-5e7f7e3a8550 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:29.240836 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-33422f7d-9445-4188-9036-5e7f7e3a8550 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:29.241270 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-33422f7d-9445-4188-9036-5e7f7e3a8550 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:29.320796 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-33422f7d-9445-4188-9036-5e7f7e3a8550 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 7202 microversion: 2.20 time: 0.093654 Dec 15 11:34:29.321527 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 297/594] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:29 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 7202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:34:29.940553 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6103b8a9-467e-4a97-b181-5970c56bfe58 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:29.941551 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6103b8a9-467e-4a97-b181-5970c56bfe58 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:29.951825 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6103b8a9-467e-4a97-b181-5970c56bfe58 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:29.952299 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6103b8a9-467e-4a97-b181-5970c56bfe58 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:29.953090 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6103b8a9-467e-4a97-b181-5970c56bfe58 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:29.953522 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6103b8a9-467e-4a97-b181-5970c56bfe58 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:30.018634 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6103b8a9-467e-4a97-b181-5970c56bfe58 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 14 microversion: 2.1 time: 0.082021 Dec 15 11:34:30.019224 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 298/595] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:29 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:34:30.331433 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-98c3312f-f9f1-4efa-a685-6b124bad5686 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:30.332425 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-98c3312f-f9f1-4efa-a685-6b124bad5686 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:30.339965 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-98c3312f-f9f1-4efa-a685-6b124bad5686 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:30.340412 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-98c3312f-f9f1-4efa-a685-6b124bad5686 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:30.341188 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-98c3312f-f9f1-4efa-a685-6b124bad5686 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:30.341877 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-98c3312f-f9f1-4efa-a685-6b124bad5686 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:30.420788 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-98c3312f-f9f1-4efa-a685-6b124bad5686 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 14558 microversion: 2.20 time: 0.093132 Dec 15 11:34:30.421339 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 298/596] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:30 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 14558 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:31.029558 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a25c3acb-31a6-4c25-b7f9-326f0cc18571 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:31.030599 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a25c3acb-31a6-4c25-b7f9-326f0cc18571 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:31.037627 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a25c3acb-31a6-4c25-b7f9-326f0cc18571 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:31.038020 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a25c3acb-31a6-4c25-b7f9-326f0cc18571 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:31.038820 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a25c3acb-31a6-4c25-b7f9-326f0cc18571 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:31.039254 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a25c3acb-31a6-4c25-b7f9-326f0cc18571 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:31.102275 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a25c3acb-31a6-4c25-b7f9-326f0cc18571 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 14 microversion: 2.1 time: 0.076581 Dec 15 11:34:31.102978 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 299/597] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:31 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:34:31.433125 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ed1b11c1-8483-49b8-a00d-e6b184bba264 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:31.434024 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-ed1b11c1-8483-49b8-a00d-e6b184bba264 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:31.440842 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ed1b11c1-8483-49b8-a00d-e6b184bba264 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:31.441285 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ed1b11c1-8483-49b8-a00d-e6b184bba264 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:31.442055 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ed1b11c1-8483-49b8-a00d-e6b184bba264 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:31.442510 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ed1b11c1-8483-49b8-a00d-e6b184bba264 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:31.515440 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ed1b11c1-8483-49b8-a00d-e6b184bba264 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 18449 microversion: 2.20 time: 0.086291 Dec 15 11:34:31.516042 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 299/598] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:31 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 18449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:32.113696 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8fb61ee7-2454-4040-bc27-5909d7aa64e2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:32.114690 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8fb61ee7-2454-4040-bc27-5909d7aa64e2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:32.121552 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8fb61ee7-2454-4040-bc27-5909d7aa64e2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:32.121969 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8fb61ee7-2454-4040-bc27-5909d7aa64e2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:32.123078 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8fb61ee7-2454-4040-bc27-5909d7aa64e2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:32.123465 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8fb61ee7-2454-4040-bc27-5909d7aa64e2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:32.182872 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8fb61ee7-2454-4040-bc27-5909d7aa64e2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 14 microversion: 2.1 time: 0.073059 Dec 15 11:34:32.183481 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 300/599] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:32 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:34:32.527552 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e1b9cf34-d67b-41d4-91bf-a6310ddbb169 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:32.528581 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e1b9cf34-d67b-41d4-91bf-a6310ddbb169 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:32.535603 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e1b9cf34-d67b-41d4-91bf-a6310ddbb169 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:32.536082 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e1b9cf34-d67b-41d4-91bf-a6310ddbb169 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:32.536927 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e1b9cf34-d67b-41d4-91bf-a6310ddbb169 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:32.537360 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e1b9cf34-d67b-41d4-91bf-a6310ddbb169 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:32.611828 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e1b9cf34-d67b-41d4-91bf-a6310ddbb169 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 19133 microversion: 2.20 time: 0.088358 Dec 15 11:34:32.612436 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 300/600] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:32 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 19133 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:33.099407 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1881494051", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-199429054", "security_groups": [{"name": "tempest-secgroup-smoke-2141571983"}], "networks": [{"uuid": "6d49f0ca-39d0-4d9e-bb85-d439c40e47fd"}], "block_device_mapping_v2": [{"uuid": "06f41b47-38da-4418-88dc-919722261903", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:33.194597 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-dd480228-4044-4455-86c1-560765d154dd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:33.195642 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-dd480228-4044-4455-86c1-560765d154dd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:33.202845 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dd480228-4044-4455-86c1-560765d154dd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:33.203411 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dd480228-4044-4455-86c1-560765d154dd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:33.204216 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dd480228-4044-4455-86c1-560765d154dd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:33.204650 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dd480228-4044-4455-86c1-560765d154dd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:33.266477 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-dd480228-4044-4455-86c1-560765d154dd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 14 microversion: 2.1 time: 0.076496 Dec 15 11:34:33.267156 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 301/601] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:33 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 11:34:33.409896 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] validate_networks() for [('6d49f0ca-39d0-4d9e-bb85-d439c40e47fd', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:34:33.624216 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-74af9c79-c4cd-4807-84c5-bb679d2d5bf4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:33.625253 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-74af9c79-c4cd-4807-84c5-bb679d2d5bf4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:33.632579 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74af9c79-c4cd-4807-84c5-bb679d2d5bf4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:33.633056 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74af9c79-c4cd-4807-84c5-bb679d2d5bf4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:33.633835 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74af9c79-c4cd-4807-84c5-bb679d2d5bf4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:33.634263 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74af9c79-c4cd-4807-84c5-bb679d2d5bf4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:33.713788 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-74af9c79-c4cd-4807-84c5-bb679d2d5bf4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 21570 microversion: 2.20 time: 0.093426 Dec 15 11:34:33.717794 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 302/602] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:33 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 21570 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:34:33.768998 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:34:33.769422 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:34:33.769898 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:34:33.770305 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:34:33.771386 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:34:33.780018 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:33.780463 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:33.781269 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:33.781699 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:33.798189 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Getting quotas for project c33910c71a6444d4a48fe8455c0736d5. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:34:33.802073 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Getting quotas for user 9f3d4afb45294feb8c7f61d0abfd1334 and project c33910c71a6444d4a48fe8455c0736d5. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:34:33.873681 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:34:33.876076 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06f41b47-38da-4418-88dc-919722261903',volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:34:33.999863 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4e66c382-3d43-4db5-9825-14528cbc63eb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.904440 Dec 15 11:34:34.000502 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 301/603] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:34:33 2021] POST /compute/v2.1/servers => generated 406 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:34:34.011435 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3eedf30e-c5fd-4cd2-993c-493a00d16fa7 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:34.012145 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3eedf30e-c5fd-4cd2-993c-493a00d16fa7 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:34.065054 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-3eedf30e-c5fd-4cd2-993c-493a00d16fa7 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:34.072485 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3eedf30e-c5fd-4cd2-993c-493a00d16fa7 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1088 microversion: 2.1 time: 0.064991 Dec 15 11:34:34.073049 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 303/604] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:34 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:34.277716 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9c73dffe-eab4-45f8-8d60-fe399220d374 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:34.278867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9c73dffe-eab4-45f8-8d60-fe399220d374 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:34.285444 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c73dffe-eab4-45f8-8d60-fe399220d374 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:34.286631 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c73dffe-eab4-45f8-8d60-fe399220d374 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:34.287518 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c73dffe-eab4-45f8-8d60-fe399220d374 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:34.287962 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c73dffe-eab4-45f8-8d60-fe399220d374 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:34.347875 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9c73dffe-eab4-45f8-8d60-fe399220d374 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 14 microversion: 2.1 time: 0.074188 Dec 15 11:34:34.351571 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 302/605] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:34 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:34:34.726254 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-62945c13-ddac-424b-9fde-5be3c16cab93 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:34.727176 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-62945c13-ddac-424b-9fde-5be3c16cab93 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:34.733750 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62945c13-ddac-424b-9fde-5be3c16cab93 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:34.734250 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62945c13-ddac-424b-9fde-5be3c16cab93 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:34.735051 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62945c13-ddac-424b-9fde-5be3c16cab93 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:34.735487 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-62945c13-ddac-424b-9fde-5be3c16cab93 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:34.807676 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-62945c13-ddac-424b-9fde-5be3c16cab93 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 23181 microversion: 2.20 time: 0.085869 Dec 15 11:34:34.808288 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 304/606] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:34 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 23181 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:35.089665 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f04f2e66-f7f8-4464-aa31-b2d6cc90f901 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:35.090360 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f04f2e66-f7f8-4464-aa31-b2d6cc90f901 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:35.098117 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f04f2e66-f7f8-4464-aa31-b2d6cc90f901 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:35.099444 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f04f2e66-f7f8-4464-aa31-b2d6cc90f901 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:35.100238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f04f2e66-f7f8-4464-aa31-b2d6cc90f901 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:35.100668 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f04f2e66-f7f8-4464-aa31-b2d6cc90f901 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:35.174071 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f04f2e66-f7f8-4464-aa31-b2d6cc90f901 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:35.182480 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f04f2e66-f7f8-4464-aa31-b2d6cc90f901 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1204 microversion: 2.1 time: 0.096802 Dec 15 11:34:35.183281 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 303/607] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:35 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:35.359820 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-1b56f396-7ccb-472d-bbae-b5adce4c26cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:35.361165 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-1b56f396-7ccb-472d-bbae-b5adce4c26cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:35.368138 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1b56f396-7ccb-472d-bbae-b5adce4c26cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:35.368915 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1b56f396-7ccb-472d-bbae-b5adce4c26cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:35.370073 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1b56f396-7ccb-472d-bbae-b5adce4c26cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:35.370649 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1b56f396-7ccb-472d-bbae-b5adce4c26cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:35.438983 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-1b56f396-7ccb-472d-bbae-b5adce4c26cb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 14 microversion: 2.1 time: 0.082964 Dec 15 11:34:35.440527 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 305/608] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:35 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:34:35.820626 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b1f4bebe-542e-4f45-99eb-e0b01f0eeb8d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:35.822382 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b1f4bebe-542e-4f45-99eb-e0b01f0eeb8d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:35.828755 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1f4bebe-542e-4f45-99eb-e0b01f0eeb8d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:35.829192 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1f4bebe-542e-4f45-99eb-e0b01f0eeb8d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:35.829969 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1f4bebe-542e-4f45-99eb-e0b01f0eeb8d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:35.830533 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1f4bebe-542e-4f45-99eb-e0b01f0eeb8d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:35.902415 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b1f4bebe-542e-4f45-99eb-e0b01f0eeb8d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 24386 microversion: 2.20 time: 0.087487 Dec 15 11:34:35.903939 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 304/609] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:35 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 24386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:36.200121 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-98e4b8f1-cd12-4b00-88d9-74a33f89afdf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:36.200985 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-98e4b8f1-cd12-4b00-88d9-74a33f89afdf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:36.208812 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-98e4b8f1-cd12-4b00-88d9-74a33f89afdf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:36.209700 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-98e4b8f1-cd12-4b00-88d9-74a33f89afdf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:36.210522 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-98e4b8f1-cd12-4b00-88d9-74a33f89afdf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:36.211145 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-98e4b8f1-cd12-4b00-88d9-74a33f89afdf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:36.284652 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-eff4da89-9fab-43e3-977c-2c98ce25202c req-86d27385-6f3f-461f-ad5d-195272625c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3f31c4-e258-4bb7-a7c9-795cf3c302af", "tag": "fdd01109-ae47-4e03-a1ac-0a3119e113ea"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:36.287795 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:34:36.287795 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:34:36.300803 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-eff4da89-9fab-43e3-977c-2c98ce25202c req-86d27385-6f3f-461f-ad5d-195272625c5c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:36.301530 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-eff4da89-9fab-43e3-977c-2c98ce25202c req-86d27385-6f3f-461f-ad5d-195272625c5c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:36.336749 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-eff4da89-9fab-43e3-977c-2c98ce25202c req-86d27385-6f3f-461f-ad5d-195272625c5c service nova] Creating event network-changed:fdd01109-ae47-4e03-a1ac-0a3119e113ea for instance ef3f31c4-e258-4bb7-a7c9-795cf3c302af on hv-cinder-81321 Dec 15 11:34:36.343823 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-eff4da89-9fab-43e3-977c-2c98ce25202c req-86d27385-6f3f-461f-ad5d-195272625c5c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062909 Dec 15 11:34:36.344725 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 305/610] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:34:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:34:36.393543 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-98e4b8f1-cd12-4b00-88d9-74a33f89afdf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:36.401210 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-98e4b8f1-cd12-4b00-88d9-74a33f89afdf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1260 microversion: 2.1 time: 0.205189 Dec 15 11:34:36.402051 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 306/611] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:36 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:36.451834 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5840371e-ac0a-458f-8655-5f3d2658b52b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:36.452838 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5840371e-ac0a-458f-8655-5f3d2658b52b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:36.460304 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5840371e-ac0a-458f-8655-5f3d2658b52b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:36.460751 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5840371e-ac0a-458f-8655-5f3d2658b52b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:36.462034 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5840371e-ac0a-458f-8655-5f3d2658b52b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:36.462463 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5840371e-ac0a-458f-8655-5f3d2658b52b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:36.522309 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5840371e-ac0a-458f-8655-5f3d2658b52b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 14 microversion: 2.1 time: 0.074455 Dec 15 11:34:36.525663 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 306/612] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:36 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:34:36.913868 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3b0b45de-9816-4576-aa64-381ff0715e34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:36.914841 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3b0b45de-9816-4576-aa64-381ff0715e34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:36.921135 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3b0b45de-9816-4576-aa64-381ff0715e34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:36.921588 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3b0b45de-9816-4576-aa64-381ff0715e34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:36.922374 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3b0b45de-9816-4576-aa64-381ff0715e34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:36.922838 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3b0b45de-9816-4576-aa64-381ff0715e34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:36.999448 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3b0b45de-9816-4576-aa64-381ff0715e34 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 25902 microversion: 2.20 time: 0.089785 Dec 15 11:34:37.000091 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 307/613] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:36 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 25902 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:37.418958 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-02546e3c-e94e-4135-8468-12d09c83535e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:37.419585 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-02546e3c-e94e-4135-8468-12d09c83535e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:37.426404 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02546e3c-e94e-4135-8468-12d09c83535e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:37.427309 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02546e3c-e94e-4135-8468-12d09c83535e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:37.428313 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02546e3c-e94e-4135-8468-12d09c83535e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:37.428752 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02546e3c-e94e-4135-8468-12d09c83535e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:37.533769 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2af9ba63-5f9c-475f-99b2-7964cfc89c61 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:37.534946 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2af9ba63-5f9c-475f-99b2-7964cfc89c61 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:37.542142 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2af9ba63-5f9c-475f-99b2-7964cfc89c61 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:37.542615 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2af9ba63-5f9c-475f-99b2-7964cfc89c61 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:37.543421 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2af9ba63-5f9c-475f-99b2-7964cfc89c61 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:37.543863 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2af9ba63-5f9c-475f-99b2-7964cfc89c61 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:37.563057 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-02546e3c-e94e-4135-8468-12d09c83535e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:37.570880 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-02546e3c-e94e-4135-8468-12d09c83535e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1260 microversion: 2.1 time: 0.155998 Dec 15 11:34:37.571465 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 307/614] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:37 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:37.609531 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2af9ba63-5f9c-475f-99b2-7964cfc89c61 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 14 microversion: 2.1 time: 0.079649 Dec 15 11:34:37.610148 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 308/615] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:37 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 11:34:38.012683 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d2720311-fcd9-4c48-81ba-22b2b517e38b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:38.013589 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d2720311-fcd9-4c48-81ba-22b2b517e38b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:38.019774 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2720311-fcd9-4c48-81ba-22b2b517e38b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:38.020218 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2720311-fcd9-4c48-81ba-22b2b517e38b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:38.021023 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2720311-fcd9-4c48-81ba-22b2b517e38b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:38.021451 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2720311-fcd9-4c48-81ba-22b2b517e38b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:38.099140 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d2720311-fcd9-4c48-81ba-22b2b517e38b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 26933 microversion: 2.20 time: 0.089528 Dec 15 11:34:38.099754 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 308/616] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:38 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 26933 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:38.591254 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6026e897-9e09-4071-9716-7a3b9cb3c38f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:38.592580 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6026e897-9e09-4071-9716-7a3b9cb3c38f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:38.602656 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6026e897-9e09-4071-9716-7a3b9cb3c38f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:38.603337 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6026e897-9e09-4071-9716-7a3b9cb3c38f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:38.604529 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6026e897-9e09-4071-9716-7a3b9cb3c38f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:38.605195 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6026e897-9e09-4071-9716-7a3b9cb3c38f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:38.621308 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a02053a1-79db-4603-a9b2-234dde0e2541 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:38.622312 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a02053a1-79db-4603-a9b2-234dde0e2541 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:38.629177 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a02053a1-79db-4603-a9b2-234dde0e2541 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:38.629629 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a02053a1-79db-4603-a9b2-234dde0e2541 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:38.631128 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a02053a1-79db-4603-a9b2-234dde0e2541 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:38.631566 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a02053a1-79db-4603-a9b2-234dde0e2541 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:38.704083 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a02053a1-79db-4603-a9b2-234dde0e2541 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 14 microversion: 2.1 time: 0.086590 Dec 15 11:34:38.707294 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 309/617] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:38 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 11:34:38.744739 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6026e897-9e09-4071-9716-7a3b9cb3c38f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:38.752153 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6026e897-9e09-4071-9716-7a3b9cb3c38f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1260 microversion: 2.1 time: 0.167552 Dec 15 11:34:38.752718 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 309/618] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:38 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:39.111246 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0181578a-dd68-4054-9692-7f94f2ef5d0e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:39.112239 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0181578a-dd68-4054-9692-7f94f2ef5d0e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:39.119699 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0181578a-dd68-4054-9692-7f94f2ef5d0e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:39.120138 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0181578a-dd68-4054-9692-7f94f2ef5d0e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:39.120912 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0181578a-dd68-4054-9692-7f94f2ef5d0e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:39.121334 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0181578a-dd68-4054-9692-7f94f2ef5d0e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:39.203360 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0181578a-dd68-4054-9692-7f94f2ef5d0e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 27526 microversion: 2.20 time: 0.096009 Dec 15 11:34:39.204294 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 310/619] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:39 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 27526 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:39.716218 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-dc440b17-4fc9-4cb3-aa57-abe62712e24d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:39.717388 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-dc440b17-4fc9-4cb3-aa57-abe62712e24d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:39.723593 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dc440b17-4fc9-4cb3-aa57-abe62712e24d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:39.724067 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dc440b17-4fc9-4cb3-aa57-abe62712e24d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:39.724925 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dc440b17-4fc9-4cb3-aa57-abe62712e24d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:39.725352 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dc440b17-4fc9-4cb3-aa57-abe62712e24d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:39.769420 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e7f8a584-c105-46c9-af54-5bfc885093d1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:39.770108 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e7f8a584-c105-46c9-af54-5bfc885093d1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:39.777833 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7f8a584-c105-46c9-af54-5bfc885093d1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:39.778272 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7f8a584-c105-46c9-af54-5bfc885093d1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:39.779065 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7f8a584-c105-46c9-af54-5bfc885093d1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:39.779492 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7f8a584-c105-46c9-af54-5bfc885093d1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:39.790103 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-dc440b17-4fc9-4cb3-aa57-abe62712e24d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 14 microversion: 2.1 time: 0.078313 Dec 15 11:34:39.793275 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 310/620] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:39 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:34:39.914972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e7f8a584-c105-46c9-af54-5bfc885093d1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:39.922092 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e7f8a584-c105-46c9-af54-5bfc885093d1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1260 microversion: 2.1 time: 0.156598 Dec 15 11:34:39.922667 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 311/621] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:39 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:40.215431 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-bd1b8cfd-89e7-4647-9a60-746d3cebe44b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:40.216436 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-bd1b8cfd-89e7-4647-9a60-746d3cebe44b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:40.223622 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bd1b8cfd-89e7-4647-9a60-746d3cebe44b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:40.224169 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bd1b8cfd-89e7-4647-9a60-746d3cebe44b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:40.224949 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bd1b8cfd-89e7-4647-9a60-746d3cebe44b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:40.225381 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bd1b8cfd-89e7-4647-9a60-746d3cebe44b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:40.310862 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-bd1b8cfd-89e7-4647-9a60-746d3cebe44b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 27888 microversion: 2.20 time: 0.099258 Dec 15 11:34:40.311408 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 311/622] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:40 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 27888 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:40.801454 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9dc4f48b-6d2a-4151-a914-84a69018f2cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:40.802361 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9dc4f48b-6d2a-4151-a914-84a69018f2cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:40.810083 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9dc4f48b-6d2a-4151-a914-84a69018f2cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:40.810522 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9dc4f48b-6d2a-4151-a914-84a69018f2cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:40.811475 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9dc4f48b-6d2a-4151-a914-84a69018f2cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:40.811915 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9dc4f48b-6d2a-4151-a914-84a69018f2cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:40.887337 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9dc4f48b-6d2a-4151-a914-84a69018f2cd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 6451 microversion: 2.1 time: 0.089725 Dec 15 11:34:40.887886 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 312/623] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:40 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 6451 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:40.939777 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d99c91bc-04fb-412c-99ee-a4898e35f4d3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:40.940560 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d99c91bc-04fb-412c-99ee-a4898e35f4d3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:40.947432 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d99c91bc-04fb-412c-99ee-a4898e35f4d3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:40.947871 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d99c91bc-04fb-412c-99ee-a4898e35f4d3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:40.948637 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d99c91bc-04fb-412c-99ee-a4898e35f4d3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:40.949062 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d99c91bc-04fb-412c-99ee-a4898e35f4d3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:41.080963 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d99c91bc-04fb-412c-99ee-a4898e35f4d3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:41.088912 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d99c91bc-04fb-412c-99ee-a4898e35f4d3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1260 microversion: 2.1 time: 0.153206 Dec 15 11:34:41.089475 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 312/624] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:40 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:41.323389 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-be118755-2ebb-4e95-a67f-1f8d01bf129d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:41.324379 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-be118755-2ebb-4e95-a67f-1f8d01bf129d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:41.336437 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-be118755-2ebb-4e95-a67f-1f8d01bf129d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:41.336873 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-be118755-2ebb-4e95-a67f-1f8d01bf129d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:41.337654 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-be118755-2ebb-4e95-a67f-1f8d01bf129d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:41.338079 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-be118755-2ebb-4e95-a67f-1f8d01bf129d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:41.421939 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-be118755-2ebb-4e95-a67f-1f8d01bf129d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 28199 microversion: 2.20 time: 0.102406 Dec 15 11:34:41.422585 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 313/625] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:41 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 28199 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:41.898343 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-09bb6b0a-068e-4ca9-be61-6c17256690bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:41.899291 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-09bb6b0a-068e-4ca9-be61-6c17256690bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:41.905653 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-09bb6b0a-068e-4ca9-be61-6c17256690bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:41.906101 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-09bb6b0a-068e-4ca9-be61-6c17256690bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:41.906929 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-09bb6b0a-068e-4ca9-be61-6c17256690bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:41.907364 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-09bb6b0a-068e-4ca9-be61-6c17256690bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:41.979092 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-09bb6b0a-068e-4ca9-be61-6c17256690bd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 15025 microversion: 2.1 time: 0.084764 Dec 15 11:34:41.979709 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 313/626] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:41 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 15025 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:42.105891 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3f13e736-419a-402e-bc5b-a31a596a77df tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:42.106604 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3f13e736-419a-402e-bc5b-a31a596a77df tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:42.113381 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3f13e736-419a-402e-bc5b-a31a596a77df tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:42.113823 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3f13e736-419a-402e-bc5b-a31a596a77df tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:42.115195 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3f13e736-419a-402e-bc5b-a31a596a77df tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:42.115628 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3f13e736-419a-402e-bc5b-a31a596a77df tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:42.246346 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3f13e736-419a-402e-bc5b-a31a596a77df tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:42.254621 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3f13e736-419a-402e-bc5b-a31a596a77df tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1260 microversion: 2.1 time: 0.152669 Dec 15 11:34:42.255923 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 314/627] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:42 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:42.433954 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-283eb080-fc25-4f91-8a6d-8de5d4e193c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:42.434904 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-283eb080-fc25-4f91-8a6d-8de5d4e193c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:42.441715 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-283eb080-fc25-4f91-8a6d-8de5d4e193c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:42.442156 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-283eb080-fc25-4f91-8a6d-8de5d4e193c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:42.443550 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-283eb080-fc25-4f91-8a6d-8de5d4e193c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:42.444151 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-283eb080-fc25-4f91-8a6d-8de5d4e193c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:42.517531 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-283eb080-fc25-4f91-8a6d-8de5d4e193c8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 28199 microversion: 2.20 time: 0.087620 Dec 15 11:34:42.518133 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 314/628] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:42 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 28199 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:42.990335 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-032d63bf-7bb8-4d55-bdc2-1dbcfd2c85e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:42.991265 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-032d63bf-7bb8-4d55-bdc2-1dbcfd2c85e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:42.997471 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-032d63bf-7bb8-4d55-bdc2-1dbcfd2c85e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:42.997911 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-032d63bf-7bb8-4d55-bdc2-1dbcfd2c85e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:42.998707 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-032d63bf-7bb8-4d55-bdc2-1dbcfd2c85e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:42.999136 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-032d63bf-7bb8-4d55-bdc2-1dbcfd2c85e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:43.074728 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-032d63bf-7bb8-4d55-bdc2-1dbcfd2c85e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 18013 microversion: 2.1 time: 0.087936 Dec 15 11:34:43.075698 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 315/629] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:42 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 18013 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:43.273487 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4a638045-74d8-4685-8277-fd87c0b3aa03 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:43.274084 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4a638045-74d8-4685-8277-fd87c0b3aa03 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:43.280935 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4a638045-74d8-4685-8277-fd87c0b3aa03 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:43.281391 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4a638045-74d8-4685-8277-fd87c0b3aa03 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:43.282159 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4a638045-74d8-4685-8277-fd87c0b3aa03 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:43.282621 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4a638045-74d8-4685-8277-fd87c0b3aa03 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:43.411945 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4a638045-74d8-4685-8277-fd87c0b3aa03 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:43.419635 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4a638045-74d8-4685-8277-fd87c0b3aa03 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1260 microversion: 2.1 time: 0.151081 Dec 15 11:34:43.420196 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 315/630] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:43 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:43.529564 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-549211a0-287f-41bc-bca0-3931dba3ac72 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:43.530479 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-549211a0-287f-41bc-bca0-3931dba3ac72 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:43.538073 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-549211a0-287f-41bc-bca0-3931dba3ac72 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:43.538513 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-549211a0-287f-41bc-bca0-3931dba3ac72 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:43.539306 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-549211a0-287f-41bc-bca0-3931dba3ac72 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:43.539735 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-549211a0-287f-41bc-bca0-3931dba3ac72 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:43.641687 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-549211a0-287f-41bc-bca0-3931dba3ac72 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 28490 microversion: 2.20 time: 0.116015 Dec 15 11:34:43.642638 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 316/631] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:43 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 28490 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:44.086825 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2d930d96-4e39-49b3-b3bc-c93aad86c1d3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:44.087744 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2d930d96-4e39-49b3-b3bc-c93aad86c1d3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:44.094282 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d930d96-4e39-49b3-b3bc-c93aad86c1d3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:44.094762 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d930d96-4e39-49b3-b3bc-c93aad86c1d3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:44.095538 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d930d96-4e39-49b3-b3bc-c93aad86c1d3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:44.095973 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d930d96-4e39-49b3-b3bc-c93aad86c1d3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:44.175818 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2d930d96-4e39-49b3-b3bc-c93aad86c1d3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 19133 microversion: 2.1 time: 0.093141 Dec 15 11:34:44.176444 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 316/632] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:44 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 19133 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:44.437296 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2ddc0f07-7f7e-4219-84bb-128a803d5ce1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:44.438019 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2ddc0f07-7f7e-4219-84bb-128a803d5ce1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:44.445698 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2ddc0f07-7f7e-4219-84bb-128a803d5ce1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:44.446148 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2ddc0f07-7f7e-4219-84bb-128a803d5ce1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:44.446952 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2ddc0f07-7f7e-4219-84bb-128a803d5ce1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:44.447384 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2ddc0f07-7f7e-4219-84bb-128a803d5ce1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:44.594736 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2ddc0f07-7f7e-4219-84bb-128a803d5ce1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:44.602415 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2ddc0f07-7f7e-4219-84bb-128a803d5ce1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1260 microversion: 2.1 time: 0.169271 Dec 15 11:34:44.603007 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 317/633] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:44 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:44.653708 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-85daebf7-dd23-4b01-a674-7bbc0aa433b4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:44.654736 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-85daebf7-dd23-4b01-a674-7bbc0aa433b4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:44.661680 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85daebf7-dd23-4b01-a674-7bbc0aa433b4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:44.662130 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85daebf7-dd23-4b01-a674-7bbc0aa433b4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:44.662941 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85daebf7-dd23-4b01-a674-7bbc0aa433b4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:44.663378 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-85daebf7-dd23-4b01-a674-7bbc0aa433b4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:44.749955 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-85daebf7-dd23-4b01-a674-7bbc0aa433b4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 28658 microversion: 2.20 time: 0.100199 Dec 15 11:34:44.750587 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 317/634] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:44 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 28658 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:45.187235 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-123794ed-7fb2-43d7-8d48-e46c823d7396 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:45.188152 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-123794ed-7fb2-43d7-8d48-e46c823d7396 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:45.195325 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-123794ed-7fb2-43d7-8d48-e46c823d7396 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:45.195771 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-123794ed-7fb2-43d7-8d48-e46c823d7396 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:45.196543 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-123794ed-7fb2-43d7-8d48-e46c823d7396 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:45.196969 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-123794ed-7fb2-43d7-8d48-e46c823d7396 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:45.269959 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-123794ed-7fb2-43d7-8d48-e46c823d7396 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 21519 microversion: 2.1 time: 0.086234 Dec 15 11:34:45.270595 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 318/635] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:45 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 21519 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:45.620343 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-1a43ab6a-f150-4c0c-88f7-96c8e2a008ef tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:45.621071 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-1a43ab6a-f150-4c0c-88f7-96c8e2a008ef tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:45.627964 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a43ab6a-f150-4c0c-88f7-96c8e2a008ef tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:45.628410 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a43ab6a-f150-4c0c-88f7-96c8e2a008ef tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:45.629186 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a43ab6a-f150-4c0c-88f7-96c8e2a008ef tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:45.629625 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-1a43ab6a-f150-4c0c-88f7-96c8e2a008ef tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:45.762136 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2cc04a3b-bd29-491d-8882-d69449287c50 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:45.763393 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2cc04a3b-bd29-491d-8882-d69449287c50 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:45.766798 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-1a43ab6a-f150-4c0c-88f7-96c8e2a008ef tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:45.770200 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cc04a3b-bd29-491d-8882-d69449287c50 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:45.770671 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cc04a3b-bd29-491d-8882-d69449287c50 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:45.771505 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cc04a3b-bd29-491d-8882-d69449287c50 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:45.771936 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2cc04a3b-bd29-491d-8882-d69449287c50 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:45.774990 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-1a43ab6a-f150-4c0c-88f7-96c8e2a008ef tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1260 microversion: 2.1 time: 0.158609 Dec 15 11:34:45.775916 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 318/636] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:45 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:45.853250 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2cc04a3b-bd29-491d-8882-d69449287c50 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 28658 microversion: 2.20 time: 0.095161 Dec 15 11:34:45.853874 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 319/637] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:45 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 28658 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:34:46.280604 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e6fdafba-ba96-4c15-ae63-93dfcc4fdf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:46.281548 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e6fdafba-ba96-4c15-ae63-93dfcc4fdf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:46.287852 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6fdafba-ba96-4c15-ae63-93dfcc4fdf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:46.288298 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6fdafba-ba96-4c15-ae63-93dfcc4fdf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:46.289072 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6fdafba-ba96-4c15-ae63-93dfcc4fdf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:46.289505 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6fdafba-ba96-4c15-ae63-93dfcc4fdf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:46.366863 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e6fdafba-ba96-4c15-ae63-93dfcc4fdf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 22987 microversion: 2.1 time: 0.089677 Dec 15 11:34:46.367486 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 319/638] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:46 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 22987 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:34:46.791263 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-89b738ad-424f-4643-a94d-a8ab6f9a3dc9 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:46.791955 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-89b738ad-424f-4643-a94d-a8ab6f9a3dc9 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:46.798818 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89b738ad-424f-4643-a94d-a8ab6f9a3dc9 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:46.799260 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89b738ad-424f-4643-a94d-a8ab6f9a3dc9 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:46.800025 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89b738ad-424f-4643-a94d-a8ab6f9a3dc9 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:46.800450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89b738ad-424f-4643-a94d-a8ab6f9a3dc9 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:46.866352 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-58de9b92-80d5-4b1b-959b-834d0f70e1a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:46.867382 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-58de9b92-80d5-4b1b-959b-834d0f70e1a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:46.874201 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-58de9b92-80d5-4b1b-959b-834d0f70e1a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:46.874673 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-58de9b92-80d5-4b1b-959b-834d0f70e1a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:46.875461 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-58de9b92-80d5-4b1b-959b-834d0f70e1a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:46.875900 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-58de9b92-80d5-4b1b-959b-834d0f70e1a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:46.932169 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-89b738ad-424f-4643-a94d-a8ab6f9a3dc9 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:46.939999 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-89b738ad-424f-4643-a94d-a8ab6f9a3dc9 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1260 microversion: 2.1 time: 0.152700 Dec 15 11:34:46.940566 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 320/639] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:46 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:46.946821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-58de9b92-80d5-4b1b-959b-834d0f70e1a7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 28658 microversion: 2.20 time: 0.085075 Dec 15 11:34:46.948124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 320/640] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:46 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 28658 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:34:47.377577 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bbb3362e-c1ec-4dda-870f-85d50677ea03 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:47.378581 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bbb3362e-c1ec-4dda-870f-85d50677ea03 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:47.385004 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bbb3362e-c1ec-4dda-870f-85d50677ea03 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:47.385480 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bbb3362e-c1ec-4dda-870f-85d50677ea03 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:47.386298 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bbb3362e-c1ec-4dda-870f-85d50677ea03 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:47.386772 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bbb3362e-c1ec-4dda-870f-85d50677ea03 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:47.464102 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bbb3362e-c1ec-4dda-870f-85d50677ea03 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 24043 microversion: 2.1 time: 0.089906 Dec 15 11:34:47.464786 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 321/641] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:47 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 24043 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:47.577292 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-f2af14b7-e546-4968-9cd2-9113ad7fcef0 req-5a038999-6679-42b0-bddb-dd4c57ed6af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3f31c4-e258-4bb7-a7c9-795cf3c302af", "name": "network-vif-plugged", "status": "completed", "tag": "fdd01109-ae47-4e03-a1ac-0a3119e113ea"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:47.578893 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:34:47.578893 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:34:47.587107 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-f2af14b7-e546-4968-9cd2-9113ad7fcef0 req-5a038999-6679-42b0-bddb-dd4c57ed6af4 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:47.587544 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-f2af14b7-e546-4968-9cd2-9113ad7fcef0 req-5a038999-6679-42b0-bddb-dd4c57ed6af4 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:47.599238 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-f2af14b7-e546-4968-9cd2-9113ad7fcef0 req-5a038999-6679-42b0-bddb-dd4c57ed6af4 service nova] Creating event network-vif-plugged:fdd01109-ae47-4e03-a1ac-0a3119e113ea for instance ef3f31c4-e258-4bb7-a7c9-795cf3c302af on hv-cinder-81321 Dec 15 11:34:47.603974 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-f2af14b7-e546-4968-9cd2-9113ad7fcef0 req-5a038999-6679-42b0-bddb-dd4c57ed6af4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030782 Dec 15 11:34:47.604544 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 321/642] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:34:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:34:47.958736 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a59fb478-d6ad-4385-b4cb-e1106224497d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:47.959437 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-74bb4c45-7cf5-4899-a4a7-6773aeb40d04 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:47.959901 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a59fb478-d6ad-4385-b4cb-e1106224497d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:47.960190 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-74bb4c45-7cf5-4899-a4a7-6773aeb40d04 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:47.966206 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74bb4c45-7cf5-4899-a4a7-6773aeb40d04 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:47.966691 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74bb4c45-7cf5-4899-a4a7-6773aeb40d04 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:47.966883 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a59fb478-d6ad-4385-b4cb-e1106224497d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:47.967606 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a59fb478-d6ad-4385-b4cb-e1106224497d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:47.967875 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74bb4c45-7cf5-4899-a4a7-6773aeb40d04 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:47.968308 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-74bb4c45-7cf5-4899-a4a7-6773aeb40d04 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:47.968420 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a59fb478-d6ad-4385-b4cb-e1106224497d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:47.968806 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a59fb478-d6ad-4385-b4cb-e1106224497d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:48.131555 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a59fb478-d6ad-4385-b4cb-e1106224497d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 28658 microversion: 2.20 time: 0.176813 Dec 15 11:34:48.132583 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 322/643] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:47 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 28658 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:48.194795 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-74bb4c45-7cf5-4899-a4a7-6773aeb40d04 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:48.202037 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-74bb4c45-7cf5-4899-a4a7-6773aeb40d04 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1260 microversion: 2.1 time: 0.247100 Dec 15 11:34:48.202612 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 322/644] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:47 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:48.477280 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6448d813-e595-4387-a2b3-4799a3dbe051 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:48.478273 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6448d813-e595-4387-a2b3-4799a3dbe051 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:48.485573 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6448d813-e595-4387-a2b3-4799a3dbe051 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:48.486022 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6448d813-e595-4387-a2b3-4799a3dbe051 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:48.486830 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6448d813-e595-4387-a2b3-4799a3dbe051 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:48.487279 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6448d813-e595-4387-a2b3-4799a3dbe051 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:48.570375 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6448d813-e595-4387-a2b3-4799a3dbe051 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 25332 microversion: 2.1 time: 0.097804 Dec 15 11:34:48.571288 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 323/645] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:48 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 25332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:49.142359 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-9c3b82e4-19b9-4a21-9d61-249fe1a27fdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:49.143307 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-9c3b82e4-19b9-4a21-9d61-249fe1a27fdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:49.150702 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9c3b82e4-19b9-4a21-9d61-249fe1a27fdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:49.151149 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9c3b82e4-19b9-4a21-9d61-249fe1a27fdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:49.151928 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9c3b82e4-19b9-4a21-9d61-249fe1a27fdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:49.152360 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9c3b82e4-19b9-4a21-9d61-249fe1a27fdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:49.220059 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7c80bd22-2b24-4162-8210-9c56f459911e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:49.220762 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7c80bd22-2b24-4162-8210-9c56f459911e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:49.228278 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7c80bd22-2b24-4162-8210-9c56f459911e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:49.228722 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7c80bd22-2b24-4162-8210-9c56f459911e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:49.229495 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7c80bd22-2b24-4162-8210-9c56f459911e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:49.229927 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7c80bd22-2b24-4162-8210-9c56f459911e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:49.245514 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-9c3b82e4-19b9-4a21-9d61-249fe1a27fdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 28683 microversion: 2.20 time: 0.106585 Dec 15 11:34:49.246439 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 323/646] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:49 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 28683 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:49.364098 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7c80bd22-2b24-4162-8210-9c56f459911e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:49.371825 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7c80bd22-2b24-4162-8210-9c56f459911e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1444 microversion: 2.1 time: 0.156096 Dec 15 11:34:49.372387 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 324/647] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:49 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:34:49.388931 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8c45a689-b7ed-4404-be04-f5b620fdec68 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:34:49.389631 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8c45a689-b7ed-4404-be04-f5b620fdec68 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:49.397301 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8c45a689-b7ed-4404-be04-f5b620fdec68 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:49.397688 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8c45a689-b7ed-4404-be04-f5b620fdec68 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:49.398461 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8c45a689-b7ed-4404-be04-f5b620fdec68 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:49.398958 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8c45a689-b7ed-4404-be04-f5b620fdec68 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:49.533020 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8c45a689-b7ed-4404-be04-f5b620fdec68 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:34:49.540541 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8c45a689-b7ed-4404-be04-f5b620fdec68 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1444 microversion: 2.1 time: 0.155613 Dec 15 11:34:49.541106 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 324/648] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:34:49 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:34:49.581380 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-32171bca-80bd-460c-8422-3d8906c1a723 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:49.582315 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-32171bca-80bd-460c-8422-3d8906c1a723 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:49.589277 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-32171bca-80bd-460c-8422-3d8906c1a723 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:49.589720 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-32171bca-80bd-460c-8422-3d8906c1a723 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:49.590531 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-32171bca-80bd-460c-8422-3d8906c1a723 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:49.590994 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-32171bca-80bd-460c-8422-3d8906c1a723 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:49.682398 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-32171bca-80bd-460c-8422-3d8906c1a723 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 26327 microversion: 2.1 time: 0.104619 Dec 15 11:34:49.683180 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 325/649] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:49 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 26327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:50.258263 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c99d14a4-79aa-49fa-a01e-0b8b1cccd177 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:50.259150 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c99d14a4-79aa-49fa-a01e-0b8b1cccd177 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:50.265234 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c99d14a4-79aa-49fa-a01e-0b8b1cccd177 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:50.265680 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c99d14a4-79aa-49fa-a01e-0b8b1cccd177 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:50.266451 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c99d14a4-79aa-49fa-a01e-0b8b1cccd177 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:50.266905 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c99d14a4-79aa-49fa-a01e-0b8b1cccd177 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:50.352267 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c99d14a4-79aa-49fa-a01e-0b8b1cccd177 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 30354 microversion: 2.20 time: 0.098275 Dec 15 11:34:50.352927 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 325/650] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:50 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 30354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:50.694385 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-80a8a42d-0454-44b3-bc57-52d290cce786 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:50.695452 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-80a8a42d-0454-44b3-bc57-52d290cce786 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:50.702069 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-80a8a42d-0454-44b3-bc57-52d290cce786 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:50.702510 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-80a8a42d-0454-44b3-bc57-52d290cce786 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:50.703312 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-80a8a42d-0454-44b3-bc57-52d290cce786 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:50.703747 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-80a8a42d-0454-44b3-bc57-52d290cce786 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:50.784997 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-80a8a42d-0454-44b3-bc57-52d290cce786 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 27226 microversion: 2.1 time: 0.095074 Dec 15 11:34:50.785679 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 326/651] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:50 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 27226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:51.166781 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-3f3a11ab-ad79-4d2c-9f43-8f7d0f9a386e req-0721ba42-8722-4986-a7a4-96aeafadd0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3f31c4-e258-4bb7-a7c9-795cf3c302af", "tag": "fdd01109-ae47-4e03-a1ac-0a3119e113ea"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:51.168264 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:34:51.168264 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:34:51.176320 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-3f3a11ab-ad79-4d2c-9f43-8f7d0f9a386e req-0721ba42-8722-4986-a7a4-96aeafadd0f6 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:51.176781 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-3f3a11ab-ad79-4d2c-9f43-8f7d0f9a386e req-0721ba42-8722-4986-a7a4-96aeafadd0f6 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:51.188221 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-3f3a11ab-ad79-4d2c-9f43-8f7d0f9a386e req-0721ba42-8722-4986-a7a4-96aeafadd0f6 service nova] Creating event network-changed:fdd01109-ae47-4e03-a1ac-0a3119e113ea for instance ef3f31c4-e258-4bb7-a7c9-795cf3c302af on hv-cinder-81321 Dec 15 11:34:51.193334 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-3f3a11ab-ad79-4d2c-9f43-8f7d0f9a386e req-0721ba42-8722-4986-a7a4-96aeafadd0f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031296 Dec 15 11:34:51.194129 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 326/652] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:34:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:34:51.364404 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-13014280-7d10-4937-b416-1614f36a6691 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:51.365973 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-13014280-7d10-4937-b416-1614f36a6691 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:51.373131 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13014280-7d10-4937-b416-1614f36a6691 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:51.373575 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13014280-7d10-4937-b416-1614f36a6691 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:51.374584 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13014280-7d10-4937-b416-1614f36a6691 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:51.375036 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13014280-7d10-4937-b416-1614f36a6691 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:51.457216 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-13014280-7d10-4937-b416-1614f36a6691 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 31956 microversion: 2.20 time: 0.096681 Dec 15 11:34:51.459237 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 327/653] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:51 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 31956 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:51.797621 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-69412a93-b1c4-470b-adbf-4d83231cc43f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:51.798541 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-69412a93-b1c4-470b-adbf-4d83231cc43f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:51.806107 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69412a93-b1c4-470b-adbf-4d83231cc43f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:51.806557 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69412a93-b1c4-470b-adbf-4d83231cc43f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:51.807397 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69412a93-b1c4-470b-adbf-4d83231cc43f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:51.807836 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69412a93-b1c4-470b-adbf-4d83231cc43f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:51.891559 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-69412a93-b1c4-470b-adbf-4d83231cc43f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 27736 microversion: 2.1 time: 0.097920 Dec 15 11:34:51.895407 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 327/654] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:51 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 27736 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:52.473024 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6c2f72cd-e77f-409d-a685-698771e28bc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:52.474552 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6c2f72cd-e77f-409d-a685-698771e28bc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:52.481615 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c2f72cd-e77f-409d-a685-698771e28bc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:52.482055 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c2f72cd-e77f-409d-a685-698771e28bc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:52.482871 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c2f72cd-e77f-409d-a685-698771e28bc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:52.483297 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c2f72cd-e77f-409d-a685-698771e28bc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:52.573474 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6c2f72cd-e77f-409d-a685-698771e28bc3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 33183 microversion: 2.20 time: 0.106254 Dec 15 11:34:52.574102 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 328/655] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:52 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 33183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:52.903253 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-11ba9cef-d069-4622-8179-94e90c603ed2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:52.904176 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-11ba9cef-d069-4622-8179-94e90c603ed2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:52.911096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11ba9cef-d069-4622-8179-94e90c603ed2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:52.911552 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11ba9cef-d069-4622-8179-94e90c603ed2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:52.912602 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11ba9cef-d069-4622-8179-94e90c603ed2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:52.913035 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-11ba9cef-d069-4622-8179-94e90c603ed2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:52.993937 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-11ba9cef-d069-4622-8179-94e90c603ed2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 28032 microversion: 2.1 time: 0.094684 Dec 15 11:34:52.994911 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 328/656] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:52 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 28032 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:53.586194 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f1d7032d-517b-4bdb-b944-65e12f08d8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:53.587245 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f1d7032d-517b-4bdb-b944-65e12f08d8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:53.594316 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1d7032d-517b-4bdb-b944-65e12f08d8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:53.594792 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1d7032d-517b-4bdb-b944-65e12f08d8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:53.595561 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1d7032d-517b-4bdb-b944-65e12f08d8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:53.595985 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1d7032d-517b-4bdb-b944-65e12f08d8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:53.677045 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f1d7032d-517b-4bdb-b944-65e12f08d8e8 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 33828 microversion: 2.20 time: 0.095245 Dec 15 11:34:53.678050 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 329/657] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:53 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 33828 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:54.006516 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6cab199f-fb05-467c-904e-1cdebf242240 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:54.007564 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6cab199f-fb05-467c-904e-1cdebf242240 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:54.014727 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6cab199f-fb05-467c-904e-1cdebf242240 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:54.015171 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6cab199f-fb05-467c-904e-1cdebf242240 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:54.015949 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6cab199f-fb05-467c-904e-1cdebf242240 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:54.016383 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6cab199f-fb05-467c-904e-1cdebf242240 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:54.100369 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6cab199f-fb05-467c-904e-1cdebf242240 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 28218 microversion: 2.1 time: 0.098255 Dec 15 11:34:54.100986 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 329/658] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:54 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 28218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:54.689465 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c1c7d829-0306-4524-b74a-bbb331992dc0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:54.690467 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c1c7d829-0306-4524-b74a-bbb331992dc0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:54.698134 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1c7d829-0306-4524-b74a-bbb331992dc0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:54.698602 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1c7d829-0306-4524-b74a-bbb331992dc0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:54.699418 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1c7d829-0306-4524-b74a-bbb331992dc0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:54.699856 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1c7d829-0306-4524-b74a-bbb331992dc0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:54.777809 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c1c7d829-0306-4524-b74a-bbb331992dc0 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 34714 microversion: 2.20 time: 0.092248 Dec 15 11:34:54.778456 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 330/659] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:54 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 34714 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:55.112627 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ff6f1c6e-2440-4a95-b185-b86dc245ccbc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:55.113685 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-ff6f1c6e-2440-4a95-b185-b86dc245ccbc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:55.121025 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ff6f1c6e-2440-4a95-b185-b86dc245ccbc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:55.121471 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ff6f1c6e-2440-4a95-b185-b86dc245ccbc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:55.122248 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ff6f1c6e-2440-4a95-b185-b86dc245ccbc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:55.122712 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ff6f1c6e-2440-4a95-b185-b86dc245ccbc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:55.211235 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ff6f1c6e-2440-4a95-b185-b86dc245ccbc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 28413 microversion: 2.1 time: 0.102442 Dec 15 11:34:55.211881 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 330/660] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:55 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 28413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:55.791567 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-756a8e2b-e17d-4657-b691-942b99989f98 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:55.792481 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-756a8e2b-e17d-4657-b691-942b99989f98 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:55.800025 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-756a8e2b-e17d-4657-b691-942b99989f98 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:55.800499 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-756a8e2b-e17d-4657-b691-942b99989f98 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:55.801761 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-756a8e2b-e17d-4657-b691-942b99989f98 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:55.802228 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-756a8e2b-e17d-4657-b691-942b99989f98 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:55.879756 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-756a8e2b-e17d-4657-b691-942b99989f98 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 35691 microversion: 2.20 time: 0.092933 Dec 15 11:34:55.880856 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 331/661] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:55 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 35691 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:56.223560 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-dc41a178-8dcf-4eb8-89cc-92194f2d7426 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:56.224646 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-dc41a178-8dcf-4eb8-89cc-92194f2d7426 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:56.231711 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dc41a178-8dcf-4eb8-89cc-92194f2d7426 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:56.232156 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dc41a178-8dcf-4eb8-89cc-92194f2d7426 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:56.232938 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dc41a178-8dcf-4eb8-89cc-92194f2d7426 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:56.233373 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-dc41a178-8dcf-4eb8-89cc-92194f2d7426 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:56.310199 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-dc41a178-8dcf-4eb8-89cc-92194f2d7426 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 28527 microversion: 2.1 time: 0.090521 Dec 15 11:34:56.310875 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 331/662] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:56 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 28527 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:56.892622 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fbb91db8-8f6b-4054-92a1-53c141481c03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:56.893614 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fbb91db8-8f6b-4054-92a1-53c141481c03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:56.901348 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fbb91db8-8f6b-4054-92a1-53c141481c03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:56.901793 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fbb91db8-8f6b-4054-92a1-53c141481c03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:56.902558 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fbb91db8-8f6b-4054-92a1-53c141481c03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:56.903010 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fbb91db8-8f6b-4054-92a1-53c141481c03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:56.975763 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fbb91db8-8f6b-4054-92a1-53c141481c03 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 36952 microversion: 2.20 time: 0.086612 Dec 15 11:34:56.976808 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 332/663] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:56 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 36952 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:57.322414 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-005c177c-1778-452c-b8d3-cf477927c00f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:57.323473 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-005c177c-1778-452c-b8d3-cf477927c00f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:57.330291 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-005c177c-1778-452c-b8d3-cf477927c00f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:57.330778 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-005c177c-1778-452c-b8d3-cf477927c00f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:57.331561 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-005c177c-1778-452c-b8d3-cf477927c00f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:57.332002 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-005c177c-1778-452c-b8d3-cf477927c00f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:57.411096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-005c177c-1778-452c-b8d3-cf477927c00f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 28677 microversion: 2.1 time: 0.092680 Dec 15 11:34:57.412350 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 332/664] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:57 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 28677 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:57.989549 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c48e096b-aea0-4e67-9eab-d67d75b43936 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:57.991155 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c48e096b-aea0-4e67-9eab-d67d75b43936 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:57.997999 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c48e096b-aea0-4e67-9eab-d67d75b43936 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:57.998442 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c48e096b-aea0-4e67-9eab-d67d75b43936 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:57.999244 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c48e096b-aea0-4e67-9eab-d67d75b43936 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:57.999677 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c48e096b-aea0-4e67-9eab-d67d75b43936 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:58.081267 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c48e096b-aea0-4e67-9eab-d67d75b43936 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 38156 microversion: 2.20 time: 0.095567 Dec 15 11:34:58.082228 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 333/665] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:57 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 38156 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:58.424999 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-69618533-ea2f-4c24-8837-6aa30467ed70 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:58.426020 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-69618533-ea2f-4c24-8837-6aa30467ed70 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:58.433534 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69618533-ea2f-4c24-8837-6aa30467ed70 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:58.433973 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69618533-ea2f-4c24-8837-6aa30467ed70 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:58.434777 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69618533-ea2f-4c24-8837-6aa30467ed70 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:58.435207 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69618533-ea2f-4c24-8837-6aa30467ed70 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:58.505782 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-69618533-ea2f-4c24-8837-6aa30467ed70 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 28677 microversion: 2.1 time: 0.085023 Dec 15 11:34:58.506495 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 333/666] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:58 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 28677 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:34:59.094150 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fd65d9bf-4d00-4120-adfb-22cdb1e5e13f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:59.095168 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fd65d9bf-4d00-4120-adfb-22cdb1e5e13f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:59.105117 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fd65d9bf-4d00-4120-adfb-22cdb1e5e13f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:59.105559 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fd65d9bf-4d00-4120-adfb-22cdb1e5e13f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:59.106327 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fd65d9bf-4d00-4120-adfb-22cdb1e5e13f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:59.106797 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fd65d9bf-4d00-4120-adfb-22cdb1e5e13f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:59.183085 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fd65d9bf-4d00-4120-adfb-22cdb1e5e13f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 38211 microversion: 2.20 time: 0.093279 Dec 15 11:34:59.183722 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 334/667] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:34:59 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 38211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:34:59.518013 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7cf6b08d-206c-4da9-b919-403b56a4c2a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:34:59.519085 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7cf6b08d-206c-4da9-b919-403b56a4c2a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:34:59.526175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cf6b08d-206c-4da9-b919-403b56a4c2a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:59.526742 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cf6b08d-206c-4da9-b919-403b56a4c2a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:59.527585 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cf6b08d-206c-4da9-b919-403b56a4c2a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:34:59.528100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cf6b08d-206c-4da9-b919-403b56a4c2a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:34:59.591090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7cf6b08d-206c-4da9-b919-403b56a4c2a6 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 28677 microversion: 2.1 time: 0.076954 Dec 15 11:34:59.591752 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 334/668] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:34:59 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 28677 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:00.195769 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1b44cd9c-4273-41f1-b7b7-b49257a2f614 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:00.196788 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1b44cd9c-4273-41f1-b7b7-b49257a2f614 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:00.203690 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b44cd9c-4273-41f1-b7b7-b49257a2f614 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:00.204128 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b44cd9c-4273-41f1-b7b7-b49257a2f614 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:00.204900 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b44cd9c-4273-41f1-b7b7-b49257a2f614 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:00.205325 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b44cd9c-4273-41f1-b7b7-b49257a2f614 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:00.269411 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1b44cd9c-4273-41f1-b7b7-b49257a2f614 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 38211 microversion: 2.20 time: 0.077767 Dec 15 11:35:00.274389 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 335/669] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:35:00 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 38211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:35:00.604184 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a6cee36c-6264-4d16-aac2-b8c1ea05cc8b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:00.605304 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a6cee36c-6264-4d16-aac2-b8c1ea05cc8b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:00.612186 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a6cee36c-6264-4d16-aac2-b8c1ea05cc8b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:00.612574 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a6cee36c-6264-4d16-aac2-b8c1ea05cc8b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:00.613416 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a6cee36c-6264-4d16-aac2-b8c1ea05cc8b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:00.613854 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a6cee36c-6264-4d16-aac2-b8c1ea05cc8b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:00.684001 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a6cee36c-6264-4d16-aac2-b8c1ea05cc8b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 28677 microversion: 2.1 time: 0.084399 Dec 15 11:35:00.684877 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 335/670] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:00 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 28677 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:01.282452 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-50286fc2-ca58-414f-9faa-b7c7a37d4ec6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:01.283407 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-50286fc2-ca58-414f-9faa-b7c7a37d4ec6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:01.290407 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50286fc2-ca58-414f-9faa-b7c7a37d4ec6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:01.290890 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50286fc2-ca58-414f-9faa-b7c7a37d4ec6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:01.291668 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50286fc2-ca58-414f-9faa-b7c7a37d4ec6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:01.292099 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50286fc2-ca58-414f-9faa-b7c7a37d4ec6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:01.375521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-50286fc2-ca58-414f-9faa-b7c7a37d4ec6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 38211 microversion: 2.20 time: 0.096823 Dec 15 11:35:01.376272 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 336/671] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:35:01 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 38211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:35:01.696525 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b59c3751-3517-422d-82ab-ad30f00bb783 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:01.697520 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b59c3751-3517-422d-82ab-ad30f00bb783 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:01.704318 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b59c3751-3517-422d-82ab-ad30f00bb783 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:01.704758 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b59c3751-3517-422d-82ab-ad30f00bb783 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:01.705530 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b59c3751-3517-422d-82ab-ad30f00bb783 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:01.705965 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b59c3751-3517-422d-82ab-ad30f00bb783 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:01.790126 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b59c3751-3517-422d-82ab-ad30f00bb783 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 30237 microversion: 2.1 time: 0.098019 Dec 15 11:35:01.790820 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 336/672] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:01 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 30237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:02.388401 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f5d3a9c1-83de-40a2-b289-009bdd9f52a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:02.389321 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f5d3a9c1-83de-40a2-b289-009bdd9f52a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:02.396790 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5d3a9c1-83de-40a2-b289-009bdd9f52a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:02.397238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5d3a9c1-83de-40a2-b289-009bdd9f52a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:02.398016 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5d3a9c1-83de-40a2-b289-009bdd9f52a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:02.398450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5d3a9c1-83de-40a2-b289-009bdd9f52a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:02.472716 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f5d3a9c1-83de-40a2-b289-009bdd9f52a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 200 len: 38351 microversion: 2.20 time: 0.088285 Dec 15 11:35:02.473345 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 337/673] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:35:02 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 38351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:35:02.484102 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-95bbe31f-81af-4848-8272-afb636d1bf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:02.484690 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-95bbe31f-81af-4848-8272-afb636d1bf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:02.492326 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-95bbe31f-81af-4848-8272-afb636d1bf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:02.492782 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-95bbe31f-81af-4848-8272-afb636d1bf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:02.493563 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-95bbe31f-81af-4848-8272-afb636d1bf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:02.494002 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-95bbe31f-81af-4848-8272-afb636d1bf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:02.517793 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-95bbe31f-81af-4848-8272-afb636d1bf65 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/ips" status: 200 len: 149 microversion: 2.20 time: 0.037748 Dec 15 11:35:02.518359 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 337/674] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Dec 15 11:35:02 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:02.801717 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3c8bd4e3-da44-4a67-8c77-8950abf20e6f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:02.802916 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3c8bd4e3-da44-4a67-8c77-8950abf20e6f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:02.809757 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c8bd4e3-da44-4a67-8c77-8950abf20e6f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:02.810199 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c8bd4e3-da44-4a67-8c77-8950abf20e6f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:02.811001 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c8bd4e3-da44-4a67-8c77-8950abf20e6f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:02.811430 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c8bd4e3-da44-4a67-8c77-8950abf20e6f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:02.892951 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3c8bd4e3-da44-4a67-8c77-8950abf20e6f tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 31848 microversion: 2.1 time: 0.095062 Dec 15 11:35:02.893539 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 338/675] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:02 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 31848 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:03.905730 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ba70b7c8-8cc7-4385-8040-1de8266474b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:03.906692 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-ba70b7c8-8cc7-4385-8040-1de8266474b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:03.914281 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ba70b7c8-8cc7-4385-8040-1de8266474b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:03.914798 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ba70b7c8-8cc7-4385-8040-1de8266474b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:03.915612 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ba70b7c8-8cc7-4385-8040-1de8266474b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:03.916046 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ba70b7c8-8cc7-4385-8040-1de8266474b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:03.987269 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ba70b7c8-8cc7-4385-8040-1de8266474b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 33205 microversion: 2.1 time: 0.085534 Dec 15 11:35:03.987926 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 338/676] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:03 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 33205 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:04.999393 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6c9d8db0-ebeb-4023-9709-1a7a534a7ec2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:05.000396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6c9d8db0-ebeb-4023-9709-1a7a534a7ec2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:05.007836 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c9d8db0-ebeb-4023-9709-1a7a534a7ec2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:05.008280 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c9d8db0-ebeb-4023-9709-1a7a534a7ec2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:05.009056 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c9d8db0-ebeb-4023-9709-1a7a534a7ec2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:05.009491 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c9d8db0-ebeb-4023-9709-1a7a534a7ec2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:05.091345 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6c9d8db0-ebeb-4023-9709-1a7a534a7ec2 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 34035 microversion: 2.1 time: 0.095883 Dec 15 11:35:05.092488 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 339/677] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:04 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 34035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:06.103900 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-09e07131-9a06-4ab4-8d8f-1f194fc988c1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:06.104903 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-09e07131-9a06-4ab4-8d8f-1f194fc988c1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:06.111831 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-09e07131-9a06-4ab4-8d8f-1f194fc988c1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:06.112282 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-09e07131-9a06-4ab4-8d8f-1f194fc988c1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:06.113069 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-09e07131-9a06-4ab4-8d8f-1f194fc988c1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:06.113508 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-09e07131-9a06-4ab4-8d8f-1f194fc988c1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:06.190977 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-09e07131-9a06-4ab4-8d8f-1f194fc988c1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 35031 microversion: 2.1 time: 0.090984 Dec 15 11:35:06.191717 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 339/678] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:06 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 35031 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:07.203725 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3dc61ba8-f481-4ce8-be88-ed31e4790055 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:07.204725 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3dc61ba8-f481-4ce8-be88-ed31e4790055 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:07.212281 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3dc61ba8-f481-4ce8-be88-ed31e4790055 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:07.212724 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3dc61ba8-f481-4ce8-be88-ed31e4790055 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:07.213494 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3dc61ba8-f481-4ce8-be88-ed31e4790055 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:07.213928 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3dc61ba8-f481-4ce8-be88-ed31e4790055 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:07.288360 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3dc61ba8-f481-4ce8-be88-ed31e4790055 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 36204 microversion: 2.1 time: 0.088518 Dec 15 11:35:07.289024 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 340/679] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:07 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 36204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:07.906026 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d20593de-9c11-4622-8b86-88801532032b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-614974730"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:07.906665 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d20593de-9c11-4622-8b86-88801532032b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:07.913534 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d20593de-9c11-4622-8b86-88801532032b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:07.913980 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d20593de-9c11-4622-8b86-88801532032b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:07.914794 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d20593de-9c11-4622-8b86-88801532032b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:07.915258 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d20593de-9c11-4622-8b86-88801532032b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:08.046418 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.network.security_group_api [None req-d20593de-9c11-4622-8b86-88801532032b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Removing security group 0a1d5d47-2b43-4235-a73f-9682ffea3ec5 from port ca19bc92-54c5-4adf-83df-60896fc0b0e4 Dec 15 11:35:08.300271 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-77be1224-ebb3-455d-b480-d46eb80c6ab7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:08.301272 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-77be1224-ebb3-455d-b480-d46eb80c6ab7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:08.308177 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77be1224-ebb3-455d-b480-d46eb80c6ab7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:08.308620 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77be1224-ebb3-455d-b480-d46eb80c6ab7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:08.309396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77be1224-ebb3-455d-b480-d46eb80c6ab7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:08.309824 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77be1224-ebb3-455d-b480-d46eb80c6ab7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:08.383631 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d20593de-9c11-4622-8b86-88801532032b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "POST /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/action" status: 202 len: 0 microversion: 2.1 time: 0.481597 Dec 15 11:35:08.384229 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 340/680] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:07 2021] POST /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:35:08.389046 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-77be1224-ebb3-455d-b480-d46eb80c6ab7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 37675 microversion: 2.1 time: 0.091677 Dec 15 11:35:08.390598 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 341/681] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:08 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 37675 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:35:08.402824 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-bc06b98b-15f4-4367-a482-cda3062e0b1b req-2e92a4cb-b961-4ec3-8b47-cbe08d43c632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6c539d-01cf-4bf1-adb2-78f4278501da", "tag": "ca19bc92-54c5-4adf-83df-60896fc0b0e4"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:08.406270 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:35:08.406270 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:35:08.419240 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-bc06b98b-15f4-4367-a482-cda3062e0b1b req-2e92a4cb-b961-4ec3-8b47-cbe08d43c632 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:08.420413 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-bc06b98b-15f4-4367-a482-cda3062e0b1b req-2e92a4cb-b961-4ec3-8b47-cbe08d43c632 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:08.438963 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-bc06b98b-15f4-4367-a482-cda3062e0b1b req-2e92a4cb-b961-4ec3-8b47-cbe08d43c632 service nova] Creating event network-changed:ca19bc92-54c5-4adf-83df-60896fc0b0e4 for instance cb6c539d-01cf-4bf1-adb2-78f4278501da on hv-cinder-81321 Dec 15 11:35:08.446054 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-bc06b98b-15f4-4367-a482-cda3062e0b1b req-2e92a4cb-b961-4ec3-8b47-cbe08d43c632 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050140 Dec 15 11:35:08.447775 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 341/682] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:35:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:35:09.401857 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2d3c62f1-8d76-4c75-ad24-aa8324fcad7b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:09.402933 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2d3c62f1-8d76-4c75-ad24-aa8324fcad7b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:09.410240 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d3c62f1-8d76-4c75-ad24-aa8324fcad7b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:09.410844 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d3c62f1-8d76-4c75-ad24-aa8324fcad7b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:09.412326 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d3c62f1-8d76-4c75-ad24-aa8324fcad7b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:09.412765 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d3c62f1-8d76-4c75-ad24-aa8324fcad7b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:09.498907 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2d3c62f1-8d76-4c75-ad24-aa8324fcad7b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 38205 microversion: 2.1 time: 0.100955 Dec 15 11:35:09.499579 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 342/683] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:09 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 38205 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:35:09.687754 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-13d514c2-70e8-4e7e-b373-018b8a389d08 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:09.688348 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-13d514c2-70e8-4e7e-b373-018b8a389d08 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:09.695732 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-13d514c2-70e8-4e7e-b373-018b8a389d08 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:09.696189 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-13d514c2-70e8-4e7e-b373-018b8a389d08 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:09.696977 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-13d514c2-70e8-4e7e-b373-018b8a389d08 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:09.697416 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-13d514c2-70e8-4e7e-b373-018b8a389d08 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:09.775284 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-13d514c2-70e8-4e7e-b373-018b8a389d08 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lazy-loading 'services' on Instance uuid cb6c539d-01cf-4bf1-adb2-78f4278501da {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:35:09.844338 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-13d514c2-70e8-4e7e-b373-018b8a389d08 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/os-volume_attachments/af414ff4-c764-42e5-ac11-925f22b1d048" status: 202 len: 0 microversion: 2.1 time: 0.160502 Dec 15 11:35:09.845001 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 342/684] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:35:09 2021] DELETE /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/os-volume_attachments/af414ff4-c764-42e5-ac11-925f22b1d048 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:35:09.853992 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-00a90c5a-1082-4b2b-b21b-75a76c5d7ced tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:09.855057 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-00a90c5a-1082-4b2b-b21b-75a76c5d7ced tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:09.861733 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00a90c5a-1082-4b2b-b21b-75a76c5d7ced tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:09.862153 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00a90c5a-1082-4b2b-b21b-75a76c5d7ced tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:09.863164 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00a90c5a-1082-4b2b-b21b-75a76c5d7ced tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:09.863649 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00a90c5a-1082-4b2b-b21b-75a76c5d7ced tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:09.896067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-00a90c5a-1082-4b2b-b21b-75a76c5d7ced tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046182 Dec 15 11:35:09.896664 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 343/685] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:35:09 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:10.462426 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-89a8c94f-3faf-4861-89e9-706bb1822676 req-46320720-6447-4243-8990-f667b76c4abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6c539d-01cf-4bf1-adb2-78f4278501da", "tag": "ca19bc92-54c5-4adf-83df-60896fc0b0e4"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:10.463965 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:35:10.463965 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:35:10.471743 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-89a8c94f-3faf-4861-89e9-706bb1822676 req-46320720-6447-4243-8990-f667b76c4abf service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:10.472172 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-89a8c94f-3faf-4861-89e9-706bb1822676 req-46320720-6447-4243-8990-f667b76c4abf service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:10.483927 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-89a8c94f-3faf-4861-89e9-706bb1822676 req-46320720-6447-4243-8990-f667b76c4abf service nova] Creating event network-changed:ca19bc92-54c5-4adf-83df-60896fc0b0e4 for instance cb6c539d-01cf-4bf1-adb2-78f4278501da on hv-cinder-81321 Dec 15 11:35:10.489292 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-89a8c94f-3faf-4861-89e9-706bb1822676 req-46320720-6447-4243-8990-f667b76c4abf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030809 Dec 15 11:35:10.490514 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 343/686] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:35:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:35:10.568043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9d92a105-87a6-4102-8535-fbf0c4d89de7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:10.569469 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9d92a105-87a6-4102-8535-fbf0c4d89de7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:10.577318 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9d92a105-87a6-4102-8535-fbf0c4d89de7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:10.577767 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9d92a105-87a6-4102-8535-fbf0c4d89de7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:10.578759 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9d92a105-87a6-4102-8535-fbf0c4d89de7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:10.579609 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9d92a105-87a6-4102-8535-fbf0c4d89de7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:10.650377 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9d92a105-87a6-4102-8535-fbf0c4d89de7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 38205 microversion: 2.1 time: 0.142149 Dec 15 11:35:10.651852 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 344/687] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:10 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 38205 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 11:35:10.908492 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3c7a0543-15e3-45e8-8004-4c97efd3185e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:10.909657 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3c7a0543-15e3-45e8-8004-4c97efd3185e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:10.917201 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3c7a0543-15e3-45e8-8004-4c97efd3185e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:10.917750 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3c7a0543-15e3-45e8-8004-4c97efd3185e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:10.918558 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3c7a0543-15e3-45e8-8004-4c97efd3185e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:10.919025 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3c7a0543-15e3-45e8-8004-4c97efd3185e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:10.950909 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3c7a0543-15e3-45e8-8004-4c97efd3185e tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046963 Dec 15 11:35:10.951700 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 344/688] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:35:10 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:35:10.962834 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bf0e144e-662d-4e43-bd55-8b2b1d3b2df5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:10.963512 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bf0e144e-662d-4e43-bd55-8b2b1d3b2df5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:10.970946 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bf0e144e-662d-4e43-bd55-8b2b1d3b2df5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:10.971480 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bf0e144e-662d-4e43-bd55-8b2b1d3b2df5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:10.972281 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bf0e144e-662d-4e43-bd55-8b2b1d3b2df5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:10.972716 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bf0e144e-662d-4e43-bd55-8b2b1d3b2df5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:11.151506 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-bf0e144e-662d-4e43-bd55-8b2b1d3b2df5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] HTTP exception thrown: Instance cb6c539d-01cf-4bf1-adb2-78f4278501da is not attached to volume af414ff4-c764-42e5-ac11-925f22b1d048 Dec 15 11:35:11.152225 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bf0e144e-662d-4e43-bd55-8b2b1d3b2df5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Returning 404 to user: Instance cb6c539d-01cf-4bf1-adb2-78f4278501da is not attached to volume af414ff4-c764-42e5-ac11-925f22b1d048 {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:35:11.153132 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bf0e144e-662d-4e43-bd55-8b2b1d3b2df5 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/os-volume_attachments/af414ff4-c764-42e5-ac11-925f22b1d048" status: 404 len: 154 microversion: 2.1 time: 0.195524 Dec 15 11:35:11.153763 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 345/689] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:35:10 2021] DELETE /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da/os-volume_attachments/af414ff4-c764-42e5-ac11-925f22b1d048 => generated 154 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:35:11.662732 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4078527b-78d6-43b9-8230-dd420b083dff tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:11.663558 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4078527b-78d6-43b9-8230-dd420b083dff tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:11.669400 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4078527b-78d6-43b9-8230-dd420b083dff tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:11.669848 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4078527b-78d6-43b9-8230-dd420b083dff tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:11.670642 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4078527b-78d6-43b9-8230-dd420b083dff tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:11.671074 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4078527b-78d6-43b9-8230-dd420b083dff tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:11.745178 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4078527b-78d6-43b9-8230-dd420b083dff tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 38205 microversion: 2.1 time: 0.086046 Dec 15 11:35:11.745904 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 345/690] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:11 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 38205 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:12.282955 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9e05e0f2-42dc-41d1-ade9-3c66224db767 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:12.283483 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9e05e0f2-42dc-41d1-ade9-3c66224db767 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:12.290698 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e05e0f2-42dc-41d1-ade9-3c66224db767 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:12.291152 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e05e0f2-42dc-41d1-ade9-3c66224db767 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:12.291955 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e05e0f2-42dc-41d1-ade9-3c66224db767 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:12.292389 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e05e0f2-42dc-41d1-ade9-3c66224db767 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:12.315886 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9e05e0f2-42dc-41d1-ade9-3c66224db767 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:35:12.391656 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9e05e0f2-42dc-41d1-ade9-3c66224db767 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 204 len: 0 microversion: 2.1 time: 0.112034 Dec 15 11:35:12.395129 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 346/691] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:35:12 2021] DELETE /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:35:12.400579 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e80132b2-e474-4de8-b7bf-9c7e1a6c08e6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:12.401273 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e80132b2-e474-4de8-b7bf-9c7e1a6c08e6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:12.408170 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e80132b2-e474-4de8-b7bf-9c7e1a6c08e6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:12.408619 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e80132b2-e474-4de8-b7bf-9c7e1a6c08e6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:12.409399 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e80132b2-e474-4de8-b7bf-9c7e1a6c08e6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:12.409835 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e80132b2-e474-4de8-b7bf-9c7e1a6c08e6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:12.541442 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e80132b2-e474-4de8-b7bf-9c7e1a6c08e6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:12.548791 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e80132b2-e474-4de8-b7bf-9c7e1a6c08e6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1554 microversion: 2.1 time: 0.152218 Dec 15 11:35:12.549363 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 346/692] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:12 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:12.757650 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-79f6649c-6c95-4da2-8259-fe93b9fa18b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:12.758764 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-79f6649c-6c95-4da2-8259-fe93b9fa18b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:12.764921 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-79f6649c-6c95-4da2-8259-fe93b9fa18b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:12.765361 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-79f6649c-6c95-4da2-8259-fe93b9fa18b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:12.766165 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-79f6649c-6c95-4da2-8259-fe93b9fa18b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:12.766607 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-79f6649c-6c95-4da2-8259-fe93b9fa18b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:12.839500 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-79f6649c-6c95-4da2-8259-fe93b9fa18b1 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 38220 microversion: 2.1 time: 0.085914 Dec 15 11:35:12.840123 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 347/693] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:12 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 38220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:13.566975 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c1cb48d4-20c6-4bf3-8140-4669e21116c6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:13.568124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c1cb48d4-20c6-4bf3-8140-4669e21116c6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:13.574678 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c1cb48d4-20c6-4bf3-8140-4669e21116c6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:13.575119 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c1cb48d4-20c6-4bf3-8140-4669e21116c6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:13.575886 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c1cb48d4-20c6-4bf3-8140-4669e21116c6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:13.576315 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c1cb48d4-20c6-4bf3-8140-4669e21116c6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:13.707098 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c1cb48d4-20c6-4bf3-8140-4669e21116c6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:13.714549 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c1cb48d4-20c6-4bf3-8140-4669e21116c6 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1554 microversion: 2.1 time: 0.151289 Dec 15 11:35:13.715132 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 347/694] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:13 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:13.851518 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-45fbaad9-f434-47bb-b35e-222a9836e0fd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:13.852575 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-45fbaad9-f434-47bb-b35e-222a9836e0fd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:13.859379 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45fbaad9-f434-47bb-b35e-222a9836e0fd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:13.859821 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45fbaad9-f434-47bb-b35e-222a9836e0fd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:13.860585 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45fbaad9-f434-47bb-b35e-222a9836e0fd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:13.861015 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45fbaad9-f434-47bb-b35e-222a9836e0fd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:13.935160 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-45fbaad9-f434-47bb-b35e-222a9836e0fd tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action" status: 200 len: 38334 microversion: 2.1 time: 0.087429 Dec 15 11:35:13.936105 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 348/695] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:35:13 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/action => generated 38334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:35:13.946732 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7463ddab-cf2a-43f2-a54d-cc2fcf8e8376 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:13.947225 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7463ddab-cf2a-43f2-a54d-cc2fcf8e8376 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:13.953572 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7463ddab-cf2a-43f2-a54d-cc2fcf8e8376 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:13.954018 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7463ddab-cf2a-43f2-a54d-cc2fcf8e8376 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:13.954819 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7463ddab-cf2a-43f2-a54d-cc2fcf8e8376 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:13.955251 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7463ddab-cf2a-43f2-a54d-cc2fcf8e8376 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:13.977533 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7463ddab-cf2a-43f2-a54d-cc2fcf8e8376 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/ips" status: 200 len: 146 microversion: 2.1 time: 0.035073 Dec 15 11:35:13.978088 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 348/696] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 11:35:13 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:14.728527 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-1d77ad2b-d888-4803-8502-1fc29cdb1f2d req-f36ea3bb-f768-482e-abd0-a00e7dfefb89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb6c539d-01cf-4bf1-adb2-78f4278501da", "name": "network-vif-deleted", "tag": "ca19bc92-54c5-4adf-83df-60896fc0b0e4"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:14.729948 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:35:14.729948 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:35:14.731870 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d0c97acb-19f0-4aa9-86c5-3c97de71a713 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:14.732491 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d0c97acb-19f0-4aa9-86c5-3c97de71a713 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:14.739967 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1d77ad2b-d888-4803-8502-1fc29cdb1f2d req-f36ea3bb-f768-482e-abd0-a00e7dfefb89 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:14.740631 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d0c97acb-19f0-4aa9-86c5-3c97de71a713 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:14.740785 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1d77ad2b-d888-4803-8502-1fc29cdb1f2d req-f36ea3bb-f768-482e-abd0-a00e7dfefb89 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:14.741105 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d0c97acb-19f0-4aa9-86c5-3c97de71a713 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:14.741936 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d0c97acb-19f0-4aa9-86c5-3c97de71a713 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:14.742384 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d0c97acb-19f0-4aa9-86c5-3c97de71a713 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:14.754190 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-1d77ad2b-d888-4803-8502-1fc29cdb1f2d req-f36ea3bb-f768-482e-abd0-a00e7dfefb89 service nova] Creating event network-vif-deleted:ca19bc92-54c5-4adf-83df-60896fc0b0e4 for instance cb6c539d-01cf-4bf1-adb2-78f4278501da on hv-cinder-81321 Dec 15 11:35:14.760239 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-1d77ad2b-d888-4803-8502-1fc29cdb1f2d req-f36ea3bb-f768-482e-abd0-a00e7dfefb89 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037371 Dec 15 11:35:14.761039 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 349/697] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:35:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:14.804872 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d0c97acb-19f0-4aa9-86c5-3c97de71a713 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3878c28136e64ab6a54f5030913b867a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b901444a8394be1ba87483d8001829f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:14.813355 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d0c97acb-19f0-4aa9-86c5-3c97de71a713 tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 200 len: 1512 microversion: 2.1 time: 0.085383 Dec 15 11:35:14.814180 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 349/698] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:14 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 1512 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:15.275266 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-91e20c00-8b67-4fb6-9c0a-334d8180520e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44801a59-9794-4a5f-9d87-494672555f50"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:15.276396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-91e20c00-8b67-4fb6-9c0a-334d8180520e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:15.283215 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91e20c00-8b67-4fb6-9c0a-334d8180520e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:15.283660 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91e20c00-8b67-4fb6-9c0a-334d8180520e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:15.284433 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91e20c00-8b67-4fb6-9c0a-334d8180520e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:15.284866 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91e20c00-8b67-4fb6-9c0a-334d8180520e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:15.519763 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-91e20c00-8b67-4fb6-9c0a-334d8180520e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248979 Dec 15 11:35:15.520385 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 350/699] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:35:15 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:15.832699 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0fcf2c9f-1885-4f18-bc86-58199ccfa23c tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:15.833485 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-0fcf2c9f-1885-4f18-bc86-58199ccfa23c tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] [instance: cb6c539d-01cf-4bf1-adb2-78f4278501da] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:15.840085 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0fcf2c9f-1885-4f18-bc86-58199ccfa23c tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:15.840530 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0fcf2c9f-1885-4f18-bc86-58199ccfa23c tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:15.841634 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0fcf2c9f-1885-4f18-bc86-58199ccfa23c tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:15.842063 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0fcf2c9f-1885-4f18-bc86-58199ccfa23c tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:15.856449 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-0fcf2c9f-1885-4f18-bc86-58199ccfa23c tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] HTTP exception thrown: Instance cb6c539d-01cf-4bf1-adb2-78f4278501da could not be found. Dec 15 11:35:15.857037 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0fcf2c9f-1885-4f18-bc86-58199ccfa23c tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Returning 404 to user: Instance cb6c539d-01cf-4bf1-adb2-78f4278501da could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:35:15.857829 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0fcf2c9f-1885-4f18-bc86-58199ccfa23c tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da" status: 404 len: 111 microversion: 2.1 time: 0.029029 Dec 15 11:35:15.858445 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 350/700] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:15 2021] GET /compute/v2.1/servers/cb6c539d-01cf-4bf1-adb2-78f4278501da => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:35:15.868625 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c27aea09-53fb-47af-8ecd-239a2d6e942b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] Calling method '.version_select at 0x7fdf598da4c0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:15.886083 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c27aea09-53fb-47af-8ecd-239a2d6e942b tempest-TestMinimumBasicScenario-1798013178 tempest-TestMinimumBasicScenario-1798013178-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1810229286" status: 202 len: 0 microversion: 2.1 time: 0.022912 Dec 15 11:35:15.886883 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 351/701] 10.222.0.18 () {58 vars in 1271 bytes} [Wed Dec 15 11:35:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1810229286 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:35:20.268211 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0bf34db3-245e-4d8c-940d-f5f525fda74b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:20.268814 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-0bf34db3-245e-4d8c-940d-f5f525fda74b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:20.275070 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0bf34db3-245e-4d8c-940d-f5f525fda74b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:20.275522 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0bf34db3-245e-4d8c-940d-f5f525fda74b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:20.276315 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0bf34db3-245e-4d8c-940d-f5f525fda74b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:20.276750 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0bf34db3-245e-4d8c-940d-f5f525fda74b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:20.306795 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-0bf34db3-245e-4d8c-940d-f5f525fda74b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lazy-loading 'flavor' on Instance uuid 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:35:20.572205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0bf34db3-245e-4d8c-940d-f5f525fda74b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 202 len: 0 microversion: 2.20 time: 0.428334 Dec 15 11:35:20.572889 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 351/702] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:35:20 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:35:20.581464 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-205089e0-40e8-4fc4-8233-cd31468a4a86 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:20.582195 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-205089e0-40e8-4fc4-8233-cd31468a4a86 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:20.589927 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-205089e0-40e8-4fc4-8233-cd31468a4a86 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:20.590478 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-205089e0-40e8-4fc4-8233-cd31468a4a86 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:20.591753 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-205089e0-40e8-4fc4-8233-cd31468a4a86 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:20.592184 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-205089e0-40e8-4fc4-8233-cd31468a4a86 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:20.805446 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-205089e0-40e8-4fc4-8233-cd31468a4a86 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:20.814666 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-205089e0-40e8-4fc4-8233-cd31468a4a86 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:20.816751 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-205089e0-40e8-4fc4-8233-cd31468a4a86 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:20.818736 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-205089e0-40e8-4fc4-8233-cd31468a4a86 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.241671 Dec 15 11:35:20.819875 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 352/703] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:20 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:21.841394 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-18447f58-7a5f-451c-874b-3f64cec6f7a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:21.841394 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-18447f58-7a5f-451c-874b-3f64cec6f7a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:21.860146 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18447f58-7a5f-451c-874b-3f64cec6f7a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:21.860887 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18447f58-7a5f-451c-874b-3f64cec6f7a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:21.861891 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18447f58-7a5f-451c-874b-3f64cec6f7a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:21.862509 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18447f58-7a5f-451c-874b-3f64cec6f7a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:21.953824 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d1e9282d-f095-473c-875f-7fe6891ad730 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:21.955392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d1e9282d-f095-473c-875f-7fe6891ad730 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:21.963004 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1e9282d-f095-473c-875f-7fe6891ad730 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:21.963748 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1e9282d-f095-473c-875f-7fe6891ad730 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:21.964689 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1e9282d-f095-473c-875f-7fe6891ad730 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:21.965282 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1e9282d-f095-473c-875f-7fe6891ad730 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:21.998656 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d1e9282d-f095-473c-875f-7fe6891ad730 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048491 Dec 15 11:35:21.999609 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 353/704] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:35:21 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:22.009761 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5e817718-850b-4882-a694-5444c178db65 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:22.010258 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5e817718-850b-4882-a694-5444c178db65 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:22.016118 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e817718-850b-4882-a694-5444c178db65 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:22.016562 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e817718-850b-4882-a694-5444c178db65 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:22.017335 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e817718-850b-4882-a694-5444c178db65 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:22.017767 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e817718-850b-4882-a694-5444c178db65 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:22.046444 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5e817718-850b-4882-a694-5444c178db65 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments/44801a59-9794-4a5f-9d87-494672555f50" status: 200 len: 194 microversion: 2.1 time: 0.040824 Dec 15 11:35:22.052933 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 354/705] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Dec 15 11:35:22 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments/44801a59-9794-4a5f-9d87-494672555f50 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:22.082577 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-18447f58-7a5f-451c-874b-3f64cec6f7a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:22.098095 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-18447f58-7a5f-451c-874b-3f64cec6f7a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:22.099961 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-18447f58-7a5f-451c-874b-3f64cec6f7a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:22.101861 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-18447f58-7a5f-451c-874b-3f64cec6f7a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.266552 Dec 15 11:35:22.102535 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 352/706] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:21 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:23.121318 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ab78c1f1-5c16-470a-ac9c-e51dda1b9a09 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:23.121868 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ab78c1f1-5c16-470a-ac9c-e51dda1b9a09 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:23.129538 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab78c1f1-5c16-470a-ac9c-e51dda1b9a09 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:23.130405 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab78c1f1-5c16-470a-ac9c-e51dda1b9a09 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:23.131515 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab78c1f1-5c16-470a-ac9c-e51dda1b9a09 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:23.132099 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab78c1f1-5c16-470a-ac9c-e51dda1b9a09 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:23.289267 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ab78c1f1-5c16-470a-ac9c-e51dda1b9a09 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:23.297165 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ab78c1f1-5c16-470a-ac9c-e51dda1b9a09 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:23.298678 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ab78c1f1-5c16-470a-ac9c-e51dda1b9a09 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:23.299854 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ab78c1f1-5c16-470a-ac9c-e51dda1b9a09 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.182274 Dec 15 11:35:23.300613 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 355/707] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:23 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:23.383980 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a1560301-bdea-40bf-9047-1c6c99ad7dcb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c929fe57-0d1f-4c54-82be-61400654a566"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:23.385232 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a1560301-bdea-40bf-9047-1c6c99ad7dcb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:23.391981 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a1560301-bdea-40bf-9047-1c6c99ad7dcb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:23.392515 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a1560301-bdea-40bf-9047-1c6c99ad7dcb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:23.393389 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a1560301-bdea-40bf-9047-1c6c99ad7dcb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:23.393827 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a1560301-bdea-40bf-9047-1c6c99ad7dcb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:23.637914 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a1560301-bdea-40bf-9047-1c6c99ad7dcb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258287 Dec 15 11:35:23.638704 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 353/708] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:35:23 2021] POST /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:24.320629 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5e3a030f-1752-46a3-b23d-dbd3c09a4fd4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:24.321185 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5e3a030f-1752-46a3-b23d-dbd3c09a4fd4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:24.327853 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e3a030f-1752-46a3-b23d-dbd3c09a4fd4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:24.328301 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e3a030f-1752-46a3-b23d-dbd3c09a4fd4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:24.329097 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e3a030f-1752-46a3-b23d-dbd3c09a4fd4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:24.329529 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e3a030f-1752-46a3-b23d-dbd3c09a4fd4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:24.471250 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5e3a030f-1752-46a3-b23d-dbd3c09a4fd4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:24.481635 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5e3a030f-1752-46a3-b23d-dbd3c09a4fd4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:24.483848 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5e3a030f-1752-46a3-b23d-dbd3c09a4fd4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:24.485499 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5e3a030f-1752-46a3-b23d-dbd3c09a4fd4 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.168979 Dec 15 11:35:24.486059 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 356/709] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:24 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:25.504572 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b502c5af-19a0-4592-8d10-46149eb5de1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:25.505265 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b502c5af-19a0-4592-8d10-46149eb5de1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:25.511539 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b502c5af-19a0-4592-8d10-46149eb5de1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:25.511965 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b502c5af-19a0-4592-8d10-46149eb5de1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:25.512832 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b502c5af-19a0-4592-8d10-46149eb5de1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:25.513281 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b502c5af-19a0-4592-8d10-46149eb5de1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:25.640535 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b502c5af-19a0-4592-8d10-46149eb5de1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:25.648837 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b502c5af-19a0-4592-8d10-46149eb5de1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:25.650331 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b502c5af-19a0-4592-8d10-46149eb5de1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:25.651505 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b502c5af-19a0-4592-8d10-46149eb5de1e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.151460 Dec 15 11:35:25.652062 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 354/710] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:25 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:26.670060 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1871265e-99a6-491d-a304-d00c5bbad140 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:26.670678 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1871265e-99a6-491d-a304-d00c5bbad140 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:26.677846 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1871265e-99a6-491d-a304-d00c5bbad140 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:26.678293 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1871265e-99a6-491d-a304-d00c5bbad140 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:26.679107 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1871265e-99a6-491d-a304-d00c5bbad140 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:26.679544 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1871265e-99a6-491d-a304-d00c5bbad140 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:26.807603 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1871265e-99a6-491d-a304-d00c5bbad140 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:26.815582 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1871265e-99a6-491d-a304-d00c5bbad140 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:26.817244 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1871265e-99a6-491d-a304-d00c5bbad140 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:26.818843 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1871265e-99a6-491d-a304-d00c5bbad140 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.152503 Dec 15 11:35:26.819493 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 357/711] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:26 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:27.837729 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-9fda8a70-cc3d-4976-85db-9ba36dcfe6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:27.838390 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-9fda8a70-cc3d-4976-85db-9ba36dcfe6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:27.844956 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9fda8a70-cc3d-4976-85db-9ba36dcfe6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:27.845912 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9fda8a70-cc3d-4976-85db-9ba36dcfe6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:27.846207 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9fda8a70-cc3d-4976-85db-9ba36dcfe6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:27.846588 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9fda8a70-cc3d-4976-85db-9ba36dcfe6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:27.978265 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9fda8a70-cc3d-4976-85db-9ba36dcfe6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:27.985949 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9fda8a70-cc3d-4976-85db-9ba36dcfe6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:27.987468 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9fda8a70-cc3d-4976-85db-9ba36dcfe6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:27.988608 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-9fda8a70-cc3d-4976-85db-9ba36dcfe6a6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.154711 Dec 15 11:35:27.989317 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 355/712] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:27 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:29.005996 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e08b8c11-44cd-40eb-b67c-d35f3d6d46c6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:29.006634 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e08b8c11-44cd-40eb-b67c-d35f3d6d46c6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:29.012978 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e08b8c11-44cd-40eb-b67c-d35f3d6d46c6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:29.013430 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e08b8c11-44cd-40eb-b67c-d35f3d6d46c6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:29.014215 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e08b8c11-44cd-40eb-b67c-d35f3d6d46c6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:29.014682 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e08b8c11-44cd-40eb-b67c-d35f3d6d46c6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:29.148850 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e08b8c11-44cd-40eb-b67c-d35f3d6d46c6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:29.156731 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e08b8c11-44cd-40eb-b67c-d35f3d6d46c6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:29.158214 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e08b8c11-44cd-40eb-b67c-d35f3d6d46c6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:29.159382 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e08b8c11-44cd-40eb-b67c-d35f3d6d46c6 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.157217 Dec 15 11:35:29.159943 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 358/713] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:29 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:30.177100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-9b80e960-2734-4e9d-a405-5a7650bf5fa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:30.177764 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-9b80e960-2734-4e9d-a405-5a7650bf5fa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:30.184143 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9b80e960-2734-4e9d-a405-5a7650bf5fa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:30.184628 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9b80e960-2734-4e9d-a405-5a7650bf5fa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:30.185694 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9b80e960-2734-4e9d-a405-5a7650bf5fa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:30.185876 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9b80e960-2734-4e9d-a405-5a7650bf5fa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:30.323216 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9b80e960-2734-4e9d-a405-5a7650bf5fa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:30.331920 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9b80e960-2734-4e9d-a405-5a7650bf5fa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:30.334948 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9b80e960-2734-4e9d-a405-5a7650bf5fa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:30.336285 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-9b80e960-2734-4e9d-a405-5a7650bf5fa1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.163011 Dec 15 11:35:30.336902 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 356/714] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:30 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:31.090332 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-49942fb1-3713-48fc-8f94-2367309abd0b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:31.091276 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-49942fb1-3713-48fc-8f94-2367309abd0b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:31.097721 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-49942fb1-3713-48fc-8f94-2367309abd0b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:31.098287 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-49942fb1-3713-48fc-8f94-2367309abd0b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:31.099209 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-49942fb1-3713-48fc-8f94-2367309abd0b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:31.099631 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-49942fb1-3713-48fc-8f94-2367309abd0b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:31.128999 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-49942fb1-3713-48fc-8f94-2367309abd0b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042692 Dec 15 11:35:31.130914 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 359/715] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:35:31 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:31.348087 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-efe55d45-5bbc-4e79-9df1-c97efddf876b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:31.348607 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-efe55d45-5bbc-4e79-9df1-c97efddf876b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:31.354914 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-efe55d45-5bbc-4e79-9df1-c97efddf876b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:31.355201 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-091257f9-aa55-4ab3-a7ee-dda5b2cbc711 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:31.355366 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-efe55d45-5bbc-4e79-9df1-c97efddf876b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:31.355881 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-091257f9-aa55-4ab3-a7ee-dda5b2cbc711 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:31.356149 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-efe55d45-5bbc-4e79-9df1-c97efddf876b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:31.356584 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-efe55d45-5bbc-4e79-9df1-c97efddf876b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:31.362260 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-091257f9-aa55-4ab3-a7ee-dda5b2cbc711 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:31.362749 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-091257f9-aa55-4ab3-a7ee-dda5b2cbc711 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:31.364046 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-091257f9-aa55-4ab3-a7ee-dda5b2cbc711 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:31.364563 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-091257f9-aa55-4ab3-a7ee-dda5b2cbc711 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:31.386658 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-efe55d45-5bbc-4e79-9df1-c97efddf876b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments/44801a59-9794-4a5f-9d87-494672555f50" status: 200 len: 194 microversion: 2.1 time: 0.042424 Dec 15 11:35:31.387264 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 357/716] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Dec 15 11:35:31 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments/44801a59-9794-4a5f-9d87-494672555f50 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:31.396596 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3e1d7f8b-2820-425e-bf1e-05b146c9f30e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:31.397088 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3e1d7f8b-2820-425e-bf1e-05b146c9f30e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:31.404024 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e1d7f8b-2820-425e-bf1e-05b146c9f30e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:31.405169 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e1d7f8b-2820-425e-bf1e-05b146c9f30e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:31.405308 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e1d7f8b-2820-425e-bf1e-05b146c9f30e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:31.405739 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e1d7f8b-2820-425e-bf1e-05b146c9f30e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:31.484446 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-3e1d7f8b-2820-425e-bf1e-05b146c9f30e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lazy-loading 'services' on Instance uuid 52997851-a1cb-48b6-b627-5e8c3f3353d1 {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:35:31.501380 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-091257f9-aa55-4ab3-a7ee-dda5b2cbc711 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:31.510639 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-091257f9-aa55-4ab3-a7ee-dda5b2cbc711 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:31.512218 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-091257f9-aa55-4ab3-a7ee-dda5b2cbc711 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:31.513482 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-091257f9-aa55-4ab3-a7ee-dda5b2cbc711 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.162292 Dec 15 11:35:31.514039 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 360/717] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:31 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:35:31.552400 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3e1d7f8b-2820-425e-bf1e-05b146c9f30e tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "DELETE /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments/44801a59-9794-4a5f-9d87-494672555f50" status: 202 len: 0 microversion: 2.1 time: 0.159394 Dec 15 11:35:31.552988 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 358/718] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:35:31 2021] DELETE /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments/44801a59-9794-4a5f-9d87-494672555f50 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:35:32.532280 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c54f7bc7-816d-4f98-8ce9-46d4d32573b9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:32.533412 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c54f7bc7-816d-4f98-8ce9-46d4d32573b9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:32.540180 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c54f7bc7-816d-4f98-8ce9-46d4d32573b9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:32.540633 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c54f7bc7-816d-4f98-8ce9-46d4d32573b9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:32.541426 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c54f7bc7-816d-4f98-8ce9-46d4d32573b9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:32.541863 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c54f7bc7-816d-4f98-8ce9-46d4d32573b9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:32.659720 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-bfdbe940-7068-4097-b4de-11761bb19a1b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:32.660395 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-bfdbe940-7068-4097-b4de-11761bb19a1b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:32.666389 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfdbe940-7068-4097-b4de-11761bb19a1b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:32.666901 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfdbe940-7068-4097-b4de-11761bb19a1b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:32.667706 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfdbe940-7068-4097-b4de-11761bb19a1b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:32.668142 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfdbe940-7068-4097-b4de-11761bb19a1b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:32.676845 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c54f7bc7-816d-4f98-8ce9-46d4d32573b9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:32.684716 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c54f7bc7-816d-4f98-8ce9-46d4d32573b9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:32.686213 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c54f7bc7-816d-4f98-8ce9-46d4d32573b9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:32.687460 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c54f7bc7-816d-4f98-8ce9-46d4d32573b9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.159828 Dec 15 11:35:32.688049 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 361/719] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:32 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:32.697195 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-bfdbe940-7068-4097-b4de-11761bb19a1b tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments/c929fe57-0d1f-4c54-82be-61400654a566" status: 200 len: 194 microversion: 2.1 time: 0.042105 Dec 15 11:35:32.700805 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 359/720] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Dec 15 11:35:32 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments/c929fe57-0d1f-4c54-82be-61400654a566 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:35:32.707891 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a1475102-ca0c-49dc-973d-d203aff900eb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:32.708610 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a1475102-ca0c-49dc-973d-d203aff900eb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:32.714479 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1475102-ca0c-49dc-973d-d203aff900eb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:32.715221 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1475102-ca0c-49dc-973d-d203aff900eb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:32.716005 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1475102-ca0c-49dc-973d-d203aff900eb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:32.716441 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1475102-ca0c-49dc-973d-d203aff900eb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:32.792530 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-a1475102-ca0c-49dc-973d-d203aff900eb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lazy-loading 'services' on Instance uuid 52997851-a1cb-48b6-b627-5e8c3f3353d1 {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:35:32.859508 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a1475102-ca0c-49dc-973d-d203aff900eb tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "DELETE /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments/c929fe57-0d1f-4c54-82be-61400654a566" status: 202 len: 0 microversion: 2.1 time: 0.155849 Dec 15 11:35:32.860086 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 362/721] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:35:32 2021] DELETE /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments/c929fe57-0d1f-4c54-82be-61400654a566 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:35:33.706463 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ae97715c-83c2-4c69-b53d-fa4ca4a83a1b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:33.707795 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-ae97715c-83c2-4c69-b53d-fa4ca4a83a1b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:33.714731 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ae97715c-83c2-4c69-b53d-fa4ca4a83a1b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:33.715185 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ae97715c-83c2-4c69-b53d-fa4ca4a83a1b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:33.715961 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ae97715c-83c2-4c69-b53d-fa4ca4a83a1b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:33.716390 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ae97715c-83c2-4c69-b53d-fa4ca4a83a1b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:33.853879 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ae97715c-83c2-4c69-b53d-fa4ca4a83a1b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:33.863920 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ae97715c-83c2-4c69-b53d-fa4ca4a83a1b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:33.865737 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ae97715c-83c2-4c69-b53d-fa4ca4a83a1b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:33.866934 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ae97715c-83c2-4c69-b53d-fa4ca4a83a1b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.164197 Dec 15 11:35:33.867472 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 360/722] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:33 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:34.009764 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bad4d1dd-e69e-4c9a-bc6b-b948a878de98 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:34.010792 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bad4d1dd-e69e-4c9a-bc6b-b948a878de98 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:34.017253 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bad4d1dd-e69e-4c9a-bc6b-b948a878de98 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:34.017699 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bad4d1dd-e69e-4c9a-bc6b-b948a878de98 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:34.018472 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bad4d1dd-e69e-4c9a-bc6b-b948a878de98 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:34.018932 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bad4d1dd-e69e-4c9a-bc6b-b948a878de98 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:34.047607 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bad4d1dd-e69e-4c9a-bc6b-b948a878de98 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041830 Dec 15 11:35:34.048065 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 363/723] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:35:34 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:35:34.149848 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4af2ddf6-78e4-4ab2-b28f-935b7c98fb41 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:34.150851 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4af2ddf6-78e4-4ab2-b28f-935b7c98fb41 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:34.156853 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4af2ddf6-78e4-4ab2-b28f-935b7c98fb41 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:34.157306 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4af2ddf6-78e4-4ab2-b28f-935b7c98fb41 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:34.158119 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4af2ddf6-78e4-4ab2-b28f-935b7c98fb41 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:34.158518 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4af2ddf6-78e4-4ab2-b28f-935b7c98fb41 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:34.187413 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4af2ddf6-78e4-4ab2-b28f-935b7c98fb41 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042650 Dec 15 11:35:34.187998 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 361/724] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:35:34 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:35:34.243774 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fe6e4c71-c202-4f63-ae47-9921da585846 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:34.244271 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fe6e4c71-c202-4f63-ae47-9921da585846 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:34.250089 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe6e4c71-c202-4f63-ae47-9921da585846 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:34.250538 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe6e4c71-c202-4f63-ae47-9921da585846 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:34.251355 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe6e4c71-c202-4f63-ae47-9921da585846 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:34.251793 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe6e4c71-c202-4f63-ae47-9921da585846 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:34.277177 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fe6e4c71-c202-4f63-ae47-9921da585846 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:35:34.352180 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fe6e4c71-c202-4f63-ae47-9921da585846 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "DELETE /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 204 len: 0 microversion: 2.1 time: 0.111628 Dec 15 11:35:34.352715 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 364/725] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:35:34 2021] DELETE /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:35:34.360996 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3c420b0a-e340-426f-b895-cec3cd5540e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:34.361612 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3c420b0a-e340-426f-b895-cec3cd5540e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:34.369099 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3c420b0a-e340-426f-b895-cec3cd5540e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:34.369762 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3c420b0a-e340-426f-b895-cec3cd5540e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:34.371200 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3c420b0a-e340-426f-b895-cec3cd5540e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:34.371657 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3c420b0a-e340-426f-b895-cec3cd5540e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:34.506103 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-3c420b0a-e340-426f-b895-cec3cd5540e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:34.513542 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3c420b0a-e340-426f-b895-cec3cd5540e7 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1674 microversion: 2.1 time: 0.156565 Dec 15 11:35:34.514100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 362/726] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:34 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:34.889025 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3043b996-8dee-4e1b-a0d4-c04a72017b4c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:34.889715 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3043b996-8dee-4e1b-a0d4-c04a72017b4c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:34.895564 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3043b996-8dee-4e1b-a0d4-c04a72017b4c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:34.896034 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3043b996-8dee-4e1b-a0d4-c04a72017b4c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:34.896785 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3043b996-8dee-4e1b-a0d4-c04a72017b4c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:34.897227 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3043b996-8dee-4e1b-a0d4-c04a72017b4c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:35.029582 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3043b996-8dee-4e1b-a0d4-c04a72017b4c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:35.037872 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3043b996-8dee-4e1b-a0d4-c04a72017b4c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:35.039462 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3043b996-8dee-4e1b-a0d4-c04a72017b4c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:35.040618 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3043b996-8dee-4e1b-a0d4-c04a72017b4c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.155670 Dec 15 11:35:35.041171 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 365/727] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:34 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:35.531252 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-869e50e2-05a8-4d20-8739-b2ead469d14d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:35.531949 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-869e50e2-05a8-4d20-8739-b2ead469d14d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:35.538630 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-869e50e2-05a8-4d20-8739-b2ead469d14d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:35.539085 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-869e50e2-05a8-4d20-8739-b2ead469d14d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:35.539871 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-869e50e2-05a8-4d20-8739-b2ead469d14d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:35.540307 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-869e50e2-05a8-4d20-8739-b2ead469d14d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:35.671089 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-869e50e2-05a8-4d20-8739-b2ead469d14d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:35.678964 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-869e50e2-05a8-4d20-8739-b2ead469d14d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1674 microversion: 2.1 time: 0.151815 Dec 15 11:35:35.679565 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 363/728] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:35 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:36.058550 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a30239fb-7525-4fd1-9af7-3044b784e3dd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:36.059172 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a30239fb-7525-4fd1-9af7-3044b784e3dd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:36.065580 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a30239fb-7525-4fd1-9af7-3044b784e3dd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:36.066701 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a30239fb-7525-4fd1-9af7-3044b784e3dd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:36.067513 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a30239fb-7525-4fd1-9af7-3044b784e3dd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:36.067948 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a30239fb-7525-4fd1-9af7-3044b784e3dd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:36.303133 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a30239fb-7525-4fd1-9af7-3044b784e3dd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:36.311266 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a30239fb-7525-4fd1-9af7-3044b784e3dd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:36.312784 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a30239fb-7525-4fd1-9af7-3044b784e3dd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:36.313964 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a30239fb-7525-4fd1-9af7-3044b784e3dd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.259100 Dec 15 11:35:36.314526 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 366/729] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:36 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:36.701286 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2cd2bf1f-8592-4a03-8100-234fa5c0cf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:36.702062 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2cd2bf1f-8592-4a03-8100-234fa5c0cf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:36.708682 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2cd2bf1f-8592-4a03-8100-234fa5c0cf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:36.709134 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2cd2bf1f-8592-4a03-8100-234fa5c0cf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:36.709938 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2cd2bf1f-8592-4a03-8100-234fa5c0cf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:36.710373 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2cd2bf1f-8592-4a03-8100-234fa5c0cf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:36.774402 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2cd2bf1f-8592-4a03-8100-234fa5c0cf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d42a79896b0419e8ea94d7cb7f23d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54b7fea367f4c6e9a7012b3cc94e56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:36.781779 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2cd2bf1f-8592-4a03-8100-234fa5c0cf9d tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 200 len: 1606 microversion: 2.1 time: 0.084345 Dec 15 11:35:36.782358 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 364/730] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:36 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 1606 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:37.168170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-2d59022f-ca49-4604-81a7-bb70d9cd3608 req-e8d7baf6-d37e-41fc-8dc9-8d57a3ee3e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52997851-a1cb-48b6-b627-5e8c3f3353d1", "name": "network-vif-deleted", "tag": "82833ca8-8969-4cc7-8f34-e7c18fd7e1c3"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:37.170023 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:35:37.170023 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:35:37.178474 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-2d59022f-ca49-4604-81a7-bb70d9cd3608 req-e8d7baf6-d37e-41fc-8dc9-8d57a3ee3e4d service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:37.179001 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-2d59022f-ca49-4604-81a7-bb70d9cd3608 req-e8d7baf6-d37e-41fc-8dc9-8d57a3ee3e4d service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:37.190907 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-2d59022f-ca49-4604-81a7-bb70d9cd3608 req-e8d7baf6-d37e-41fc-8dc9-8d57a3ee3e4d service nova] Creating event network-vif-deleted:82833ca8-8969-4cc7-8f34-e7c18fd7e1c3 for instance 52997851-a1cb-48b6-b627-5e8c3f3353d1 on hv-cinder-81321 Dec 15 11:35:37.201027 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-2d59022f-ca49-4604-81a7-bb70d9cd3608 req-e8d7baf6-d37e-41fc-8dc9-8d57a3ee3e4d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247095 Dec 15 11:35:37.201966 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 367/731] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:35:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:37.333142 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-65a8d33e-6e8f-49f2-b1fe-6918affd78fa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:37.334221 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-65a8d33e-6e8f-49f2-b1fe-6918affd78fa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:37.342008 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65a8d33e-6e8f-49f2-b1fe-6918affd78fa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:37.343221 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65a8d33e-6e8f-49f2-b1fe-6918affd78fa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:37.344220 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65a8d33e-6e8f-49f2-b1fe-6918affd78fa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:37.344854 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65a8d33e-6e8f-49f2-b1fe-6918affd78fa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:37.492398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-65a8d33e-6e8f-49f2-b1fe-6918affd78fa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:37.500718 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-65a8d33e-6e8f-49f2-b1fe-6918affd78fa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:37.502232 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-65a8d33e-6e8f-49f2-b1fe-6918affd78fa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:37.503661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-65a8d33e-6e8f-49f2-b1fe-6918affd78fa tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.174700 Dec 15 11:35:37.504411 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 365/732] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:37 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:37.799293 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-eafc8d91-1474-4e1e-a601-e22f933b1368 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:37.800174 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-eafc8d91-1474-4e1e-a601-e22f933b1368 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:37.806554 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eafc8d91-1474-4e1e-a601-e22f933b1368 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:37.807166 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eafc8d91-1474-4e1e-a601-e22f933b1368 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:37.808034 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eafc8d91-1474-4e1e-a601-e22f933b1368 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:37.808564 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eafc8d91-1474-4e1e-a601-e22f933b1368 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:37.823303 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-eafc8d91-1474-4e1e-a601-e22f933b1368 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] HTTP exception thrown: Instance 52997851-a1cb-48b6-b627-5e8c3f3353d1 could not be found. Dec 15 11:35:37.824031 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-eafc8d91-1474-4e1e-a601-e22f933b1368 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Returning 404 to user: Instance 52997851-a1cb-48b6-b627-5e8c3f3353d1 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:35:37.824935 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-eafc8d91-1474-4e1e-a601-e22f933b1368 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 404 len: 111 microversion: 2.1 time: 0.029723 Dec 15 11:35:37.825501 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 368/733] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:37 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:35:37.834403 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ba713e7f-bae1-4542-a07a-7de70709ee68 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '.version_select at 0x7fdf5996f310>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:37.852327 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ba713e7f-bae1-4542-a07a-7de70709ee68 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1068316953" status: 202 len: 0 microversion: 2.1 time: 0.022001 Dec 15 11:35:37.852918 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 366/734] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Dec 15 11:35:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1068316953 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:35:38.522526 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f1436dba-a373-4b69-b52c-eb2fbe415831 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:38.523488 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f1436dba-a373-4b69-b52c-eb2fbe415831 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:38.529809 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1436dba-a373-4b69-b52c-eb2fbe415831 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:38.530263 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1436dba-a373-4b69-b52c-eb2fbe415831 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:38.531086 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1436dba-a373-4b69-b52c-eb2fbe415831 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:38.531565 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1436dba-a373-4b69-b52c-eb2fbe415831 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:38.671914 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f1436dba-a373-4b69-b52c-eb2fbe415831 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:38.680569 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f1436dba-a373-4b69-b52c-eb2fbe415831 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:38.682089 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f1436dba-a373-4b69-b52c-eb2fbe415831 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:38.683268 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f1436dba-a373-4b69-b52c-eb2fbe415831 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.164885 Dec 15 11:35:38.683826 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 369/735] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:38 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:39.702655 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4fde5a09-7168-4dab-9a70-34150c494f8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:39.703269 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4fde5a09-7168-4dab-9a70-34150c494f8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:39.713200 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4fde5a09-7168-4dab-9a70-34150c494f8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:39.714216 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4fde5a09-7168-4dab-9a70-34150c494f8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:39.715524 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4fde5a09-7168-4dab-9a70-34150c494f8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:39.716119 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4fde5a09-7168-4dab-9a70-34150c494f8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:39.853741 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4fde5a09-7168-4dab-9a70-34150c494f8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:39.861995 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4fde5a09-7168-4dab-9a70-34150c494f8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:39.864020 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4fde5a09-7168-4dab-9a70-34150c494f8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:39.865420 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4fde5a09-7168-4dab-9a70-34150c494f8e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.167378 Dec 15 11:35:39.866016 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 367/736] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:39 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:40.770460 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c8dfeb9a-3eb8-4ad2-8b35-4139469d14b3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:40.770979 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c8dfeb9a-3eb8-4ad2-8b35-4139469d14b3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:40.777220 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8dfeb9a-3eb8-4ad2-8b35-4139469d14b3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:40.777657 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8dfeb9a-3eb8-4ad2-8b35-4139469d14b3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:40.778421 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8dfeb9a-3eb8-4ad2-8b35-4139469d14b3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:40.778884 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8dfeb9a-3eb8-4ad2-8b35-4139469d14b3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:40.792296 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-c8dfeb9a-3eb8-4ad2-8b35-4139469d14b3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] HTTP exception thrown: Instance 52997851-a1cb-48b6-b627-5e8c3f3353d1 could not be found. Dec 15 11:35:40.792868 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c8dfeb9a-3eb8-4ad2-8b35-4139469d14b3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Returning 404 to user: Instance 52997851-a1cb-48b6-b627-5e8c3f3353d1 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:35:40.793672 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c8dfeb9a-3eb8-4ad2-8b35-4139469d14b3 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "DELETE /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 404 len: 111 microversion: 2.1 time: 0.026960 Dec 15 11:35:40.794194 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 370/737] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:35:40 2021] DELETE /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 11:35:40.803171 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-21087165-0aa3-461a-a7b3-1c410f4f97dc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:40.803792 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-21087165-0aa3-461a-a7b3-1c410f4f97dc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 52997851-a1cb-48b6-b627-5e8c3f3353d1] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:40.810876 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-21087165-0aa3-461a-a7b3-1c410f4f97dc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:40.811358 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-21087165-0aa3-461a-a7b3-1c410f4f97dc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:40.812147 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-21087165-0aa3-461a-a7b3-1c410f4f97dc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:40.812585 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-21087165-0aa3-461a-a7b3-1c410f4f97dc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:40.827097 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-21087165-0aa3-461a-a7b3-1c410f4f97dc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] HTTP exception thrown: Instance 52997851-a1cb-48b6-b627-5e8c3f3353d1 could not be found. Dec 15 11:35:40.827721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-21087165-0aa3-461a-a7b3-1c410f4f97dc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Returning 404 to user: Instance 52997851-a1cb-48b6-b627-5e8c3f3353d1 could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:35:40.828548 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-21087165-0aa3-461a-a7b3-1c410f4f97dc tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1" status: 404 len: 111 microversion: 2.1 time: 0.030054 Dec 15 11:35:40.829092 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 368/738] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:40 2021] GET /compute/v2.1/servers/52997851-a1cb-48b6-b627-5e8c3f3353d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:35:40.884209 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1152c389-0e84-40bc-842e-1c8e7a467bb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:40.884885 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1152c389-0e84-40bc-842e-1c8e7a467bb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:40.892310 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1152c389-0e84-40bc-842e-1c8e7a467bb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:40.892773 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1152c389-0e84-40bc-842e-1c8e7a467bb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:40.893679 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1152c389-0e84-40bc-842e-1c8e7a467bb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:40.894135 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1152c389-0e84-40bc-842e-1c8e7a467bb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:41.027098 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1152c389-0e84-40bc-842e-1c8e7a467bb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:41.035682 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1152c389-0e84-40bc-842e-1c8e7a467bb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:41.037365 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1152c389-0e84-40bc-842e-1c8e7a467bb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:41.038551 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1152c389-0e84-40bc-842e-1c8e7a467bb5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.158648 Dec 15 11:35:41.039159 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 371/739] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:40 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:41.955859 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5cac574a-32ee-4d4c-83bd-8fad977d8691 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:41.956875 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5cac574a-32ee-4d4c-83bd-8fad977d8691 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:41.962740 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5cac574a-32ee-4d4c-83bd-8fad977d8691 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:41.963185 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5cac574a-32ee-4d4c-83bd-8fad977d8691 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:41.964228 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5cac574a-32ee-4d4c-83bd-8fad977d8691 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:41.964660 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5cac574a-32ee-4d4c-83bd-8fad977d8691 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:41.978072 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-5cac574a-32ee-4d4c-83bd-8fad977d8691 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] HTTP exception thrown: Instance 23ab2164-7f19-4c54-8e4e-91295c45a538 could not be found. Dec 15 11:35:41.978682 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5cac574a-32ee-4d4c-83bd-8fad977d8691 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Returning 404 to user: Instance 23ab2164-7f19-4c54-8e4e-91295c45a538 could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:35:41.979495 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5cac574a-32ee-4d4c-83bd-8fad977d8691 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 404 len: 111 microversion: 2.1 time: 0.027493 Dec 15 11:35:41.980013 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 369/740] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:35:41 2021] DELETE /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:35:41.987720 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-04b59dba-dc37-4316-bb18-e1718e92de05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:41.988339 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-04b59dba-dc37-4316-bb18-e1718e92de05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] [instance: 23ab2164-7f19-4c54-8e4e-91295c45a538] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:41.994777 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-04b59dba-dc37-4316-bb18-e1718e92de05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:41.995229 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-04b59dba-dc37-4316-bb18-e1718e92de05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:41.996010 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-04b59dba-dc37-4316-bb18-e1718e92de05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:41.996448 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-04b59dba-dc37-4316-bb18-e1718e92de05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:42.009767 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-04b59dba-dc37-4316-bb18-e1718e92de05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] HTTP exception thrown: Instance 23ab2164-7f19-4c54-8e4e-91295c45a538 could not be found. Dec 15 11:35:42.010359 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-04b59dba-dc37-4316-bb18-e1718e92de05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] Returning 404 to user: Instance 23ab2164-7f19-4c54-8e4e-91295c45a538 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:35:42.011210 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-04b59dba-dc37-4316-bb18-e1718e92de05 tempest-AttachVolumeTestJSON-428463048 tempest-AttachVolumeTestJSON-428463048-project] 10.222.0.18 "GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538" status: 404 len: 111 microversion: 2.1 time: 0.027210 Dec 15 11:35:42.011735 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 372/741] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:41 2021] GET /compute/v2.1/servers/23ab2164-7f19-4c54-8e4e-91295c45a538 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:35:42.056698 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a502b7f0-f957-426a-98c8-73fd1b54535e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:42.057311 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a502b7f0-f957-426a-98c8-73fd1b54535e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:42.063138 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a502b7f0-f957-426a-98c8-73fd1b54535e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:42.063584 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a502b7f0-f957-426a-98c8-73fd1b54535e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:42.064362 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a502b7f0-f957-426a-98c8-73fd1b54535e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:42.064792 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a502b7f0-f957-426a-98c8-73fd1b54535e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:42.199688 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a502b7f0-f957-426a-98c8-73fd1b54535e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:42.209035 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a502b7f0-f957-426a-98c8-73fd1b54535e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:42.210548 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a502b7f0-f957-426a-98c8-73fd1b54535e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:42.211731 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a502b7f0-f957-426a-98c8-73fd1b54535e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.158809 Dec 15 11:35:42.212290 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 370/742] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:42 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:43.229146 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-01aaa6ee-cc99-4ca0-877d-e45f681ca9cf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:43.229747 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-01aaa6ee-cc99-4ca0-877d-e45f681ca9cf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:43.236170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01aaa6ee-cc99-4ca0-877d-e45f681ca9cf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:43.236609 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01aaa6ee-cc99-4ca0-877d-e45f681ca9cf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:43.237553 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01aaa6ee-cc99-4ca0-877d-e45f681ca9cf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:43.238047 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01aaa6ee-cc99-4ca0-877d-e45f681ca9cf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:43.486027 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-01aaa6ee-cc99-4ca0-877d-e45f681ca9cf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:43.494780 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-01aaa6ee-cc99-4ca0-877d-e45f681ca9cf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:43.496078 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-01aaa6ee-cc99-4ca0-877d-e45f681ca9cf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:43.497243 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-01aaa6ee-cc99-4ca0-877d-e45f681ca9cf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.271841 Dec 15 11:35:43.497802 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 373/743] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:43 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:44.515655 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a26e1e67-4f24-4c61-917c-693c9af014bf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:44.516275 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a26e1e67-4f24-4c61-917c-693c9af014bf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:44.522623 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a26e1e67-4f24-4c61-917c-693c9af014bf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:44.523075 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a26e1e67-4f24-4c61-917c-693c9af014bf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:44.524036 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a26e1e67-4f24-4c61-917c-693c9af014bf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:44.524472 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a26e1e67-4f24-4c61-917c-693c9af014bf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:44.659698 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a26e1e67-4f24-4c61-917c-693c9af014bf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:44.667670 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a26e1e67-4f24-4c61-917c-693c9af014bf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:44.669164 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a26e1e67-4f24-4c61-917c-693c9af014bf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:44.670574 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a26e1e67-4f24-4c61-917c-693c9af014bf tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.158848 Dec 15 11:35:44.671144 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 371/744] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:44 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:45.688956 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-12c382e8-ce87-4f0b-82c2-7c13b480b61a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:45.689563 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-12c382e8-ce87-4f0b-82c2-7c13b480b61a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:45.696844 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12c382e8-ce87-4f0b-82c2-7c13b480b61a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:45.697291 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12c382e8-ce87-4f0b-82c2-7c13b480b61a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:45.698067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12c382e8-ce87-4f0b-82c2-7c13b480b61a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:45.698493 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12c382e8-ce87-4f0b-82c2-7c13b480b61a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:45.850136 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-12c382e8-ce87-4f0b-82c2-7c13b480b61a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:45.857937 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-12c382e8-ce87-4f0b-82c2-7c13b480b61a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:45.859454 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-12c382e8-ce87-4f0b-82c2-7c13b480b61a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:45.860603 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-12c382e8-ce87-4f0b-82c2-7c13b480b61a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.175344 Dec 15 11:35:45.861160 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 374/745] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:45 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:46.879463 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-934e0a4b-b5e7-4dde-bc39-1c39865e5580 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:46.880075 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-934e0a4b-b5e7-4dde-bc39-1c39865e5580 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:46.886305 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-934e0a4b-b5e7-4dde-bc39-1c39865e5580 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:46.886874 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-934e0a4b-b5e7-4dde-bc39-1c39865e5580 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:46.887585 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-934e0a4b-b5e7-4dde-bc39-1c39865e5580 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:46.888008 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-934e0a4b-b5e7-4dde-bc39-1c39865e5580 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:47.128638 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-934e0a4b-b5e7-4dde-bc39-1c39865e5580 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:47.136516 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-934e0a4b-b5e7-4dde-bc39-1c39865e5580 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:47.138000 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-934e0a4b-b5e7-4dde-bc39-1c39865e5580 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:47.139178 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-934e0a4b-b5e7-4dde-bc39-1c39865e5580 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.263660 Dec 15 11:35:47.139959 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 372/746] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:46 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:47.445437 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1304362809", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "networks": [{"uuid": "fe7cb959-01b2-414a-bfc6-36bcac9f3cda"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:47.496765 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] validate_networks() for [('fe7cb959-01b2-414a-bfc6-36bcac9f3cda', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:35:47.881510 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:35:47.881924 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:35:47.882391 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:35:47.882823 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:35:47.883233 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:35:47.891792 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:47.892230 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:47.893124 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:47.893457 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:47.909152 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Getting quotas for project 26b6e901a7324a01958df150d8e8562d. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:35:47.912937 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Getting quotas for user a345ca59614a4cfcae8233cf97b72e18 and project 26b6e901a7324a01958df150d8e8562d. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:35:47.923414 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:35:47.926272 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:35:47.969531 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e7e32418-d2a2-4e61-a73f-c6b1196a92a3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636194 Dec 15 11:35:47.970165 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 375/747] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:35:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:35:47.980094 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-1d80f8ed-96b5-49b2-b740-28d79f506774 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:47.981243 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-1d80f8ed-96b5-49b2-b740-28d79f506774 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:48.035525 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-1d80f8ed-96b5-49b2-b740-28d79f506774 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:48.042087 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-1d80f8ed-96b5-49b2-b740-28d79f506774 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1218 microversion: 2.1 time: 0.065529 Dec 15 11:35:48.042949 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 373/748] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:47 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:48.157989 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c0129362-dc8d-4270-8ba2-9ede58cd420a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:48.159222 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c0129362-dc8d-4270-8ba2-9ede58cd420a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:48.165426 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0129362-dc8d-4270-8ba2-9ede58cd420a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:48.165872 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0129362-dc8d-4270-8ba2-9ede58cd420a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:48.166715 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0129362-dc8d-4270-8ba2-9ede58cd420a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:48.167099 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0129362-dc8d-4270-8ba2-9ede58cd420a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:48.312492 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c0129362-dc8d-4270-8ba2-9ede58cd420a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:48.320872 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c0129362-dc8d-4270-8ba2-9ede58cd420a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:48.322471 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c0129362-dc8d-4270-8ba2-9ede58cd420a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:48.323873 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c0129362-dc8d-4270-8ba2-9ede58cd420a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.169552 Dec 15 11:35:48.324485 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 376/749] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:48 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:49.059665 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8d29a50e-4a45-4c2e-812b-58b2ecd11148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:49.060503 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8d29a50e-4a45-4c2e-812b-58b2ecd11148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:49.069032 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8d29a50e-4a45-4c2e-812b-58b2ecd11148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:49.069492 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8d29a50e-4a45-4c2e-812b-58b2ecd11148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:49.070287 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8d29a50e-4a45-4c2e-812b-58b2ecd11148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:49.070754 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8d29a50e-4a45-4c2e-812b-58b2ecd11148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:49.134764 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8d29a50e-4a45-4c2e-812b-58b2ecd11148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:49.142003 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8d29a50e-4a45-4c2e-812b-58b2ecd11148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1276 microversion: 2.1 time: 0.086004 Dec 15 11:35:49.142588 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 374/750] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:49 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:49.343662 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b0a872b8-2ad3-4a45-af8a-f4b6219d5375 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:49.344256 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b0a872b8-2ad3-4a45-af8a-f4b6219d5375 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:49.351025 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0a872b8-2ad3-4a45-af8a-f4b6219d5375 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:49.351497 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0a872b8-2ad3-4a45-af8a-f4b6219d5375 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:49.352282 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0a872b8-2ad3-4a45-af8a-f4b6219d5375 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:49.352712 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0a872b8-2ad3-4a45-af8a-f4b6219d5375 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:49.556934 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b0a872b8-2ad3-4a45-af8a-f4b6219d5375 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:49.565512 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b0a872b8-2ad3-4a45-af8a-f4b6219d5375 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:49.567063 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b0a872b8-2ad3-4a45-af8a-f4b6219d5375 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:49.568230 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b0a872b8-2ad3-4a45-af8a-f4b6219d5375 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.228412 Dec 15 11:35:49.568796 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 377/751] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:49 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:35:50.160754 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-353a31af-90df-40e5-b279-32aaf86ce221 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:50.161553 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-353a31af-90df-40e5-b279-32aaf86ce221 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:50.168030 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-353a31af-90df-40e5-b279-32aaf86ce221 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:50.168478 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-353a31af-90df-40e5-b279-32aaf86ce221 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:50.169447 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-353a31af-90df-40e5-b279-32aaf86ce221 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:50.169873 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-353a31af-90df-40e5-b279-32aaf86ce221 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:50.307805 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-353a31af-90df-40e5-b279-32aaf86ce221 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:50.315160 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-353a31af-90df-40e5-b279-32aaf86ce221 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1318 microversion: 2.1 time: 0.158628 Dec 15 11:35:50.315742 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 375/752] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:50 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:50.497713 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-a069debf-94ef-49eb-8a55-ea2f51cd0fbd req-4fd3c4c3-00e2-430b-b883-1bc911f0e308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6106fc8-c8d7-4470-8d4e-a238d8bba8e3", "tag": "8b1eef73-9848-4fec-b633-d73eada19195"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:50.500778 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:35:50.500778 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:35:50.512044 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-a069debf-94ef-49eb-8a55-ea2f51cd0fbd req-4fd3c4c3-00e2-430b-b883-1bc911f0e308 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:50.512820 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-a069debf-94ef-49eb-8a55-ea2f51cd0fbd req-4fd3c4c3-00e2-430b-b883-1bc911f0e308 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:50.531653 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-a069debf-94ef-49eb-8a55-ea2f51cd0fbd req-4fd3c4c3-00e2-430b-b883-1bc911f0e308 service nova] Creating event network-changed:8b1eef73-9848-4fec-b633-d73eada19195 for instance f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 on hv-cinder-81321 Dec 15 11:35:50.536901 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-a069debf-94ef-49eb-8a55-ea2f51cd0fbd req-4fd3c4c3-00e2-430b-b883-1bc911f0e308 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046697 Dec 15 11:35:50.537514 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 378/753] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:35:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:50.587385 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-109e8acf-c3fe-469a-b392-6c9ceb898f46 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:50.587985 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-109e8acf-c3fe-469a-b392-6c9ceb898f46 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:50.594159 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-109e8acf-c3fe-469a-b392-6c9ceb898f46 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:50.594783 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-109e8acf-c3fe-469a-b392-6c9ceb898f46 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:50.595575 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-109e8acf-c3fe-469a-b392-6c9ceb898f46 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:50.596072 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-109e8acf-c3fe-469a-b392-6c9ceb898f46 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:50.727570 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-109e8acf-c3fe-469a-b392-6c9ceb898f46 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:50.735362 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-109e8acf-c3fe-469a-b392-6c9ceb898f46 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:50.737446 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-109e8acf-c3fe-469a-b392-6c9ceb898f46 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:50.738743 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-109e8acf-c3fe-469a-b392-6c9ceb898f46 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.155032 Dec 15 11:35:50.739306 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 376/754] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:50 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:51.333237 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ff4ae59a-26de-4bfa-bf07-8fa07c214150 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:51.333997 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ff4ae59a-26de-4bfa-bf07-8fa07c214150 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:51.340342 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ff4ae59a-26de-4bfa-bf07-8fa07c214150 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:51.340810 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ff4ae59a-26de-4bfa-bf07-8fa07c214150 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:51.341580 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ff4ae59a-26de-4bfa-bf07-8fa07c214150 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:51.342034 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ff4ae59a-26de-4bfa-bf07-8fa07c214150 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:51.504387 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ff4ae59a-26de-4bfa-bf07-8fa07c214150 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:51.512311 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ff4ae59a-26de-4bfa-bf07-8fa07c214150 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1318 microversion: 2.1 time: 0.184023 Dec 15 11:35:51.512923 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 379/755] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:51 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:51.756231 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-52905eaf-abcc-47a2-832f-802da724f710 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:51.756835 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-52905eaf-abcc-47a2-832f-802da724f710 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:51.763651 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-52905eaf-abcc-47a2-832f-802da724f710 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:51.764185 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-52905eaf-abcc-47a2-832f-802da724f710 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:51.764993 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-52905eaf-abcc-47a2-832f-802da724f710 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:51.765414 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-52905eaf-abcc-47a2-832f-802da724f710 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:51.895722 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-52905eaf-abcc-47a2-832f-802da724f710 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:51.903352 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-52905eaf-abcc-47a2-832f-802da724f710 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:51.904851 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-52905eaf-abcc-47a2-832f-802da724f710 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:51.906164 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-52905eaf-abcc-47a2-832f-802da724f710 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1741 microversion: 2.20 time: 0.154272 Dec 15 11:35:51.906766 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 377/756] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:51 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:52.529704 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f951f1c8-24ea-4a1d-bb0d-8cf4406569fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:52.530347 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f951f1c8-24ea-4a1d-bb0d-8cf4406569fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:52.537185 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f951f1c8-24ea-4a1d-bb0d-8cf4406569fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:52.537624 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f951f1c8-24ea-4a1d-bb0d-8cf4406569fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:52.538389 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f951f1c8-24ea-4a1d-bb0d-8cf4406569fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:52.538843 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f951f1c8-24ea-4a1d-bb0d-8cf4406569fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:52.667420 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f951f1c8-24ea-4a1d-bb0d-8cf4406569fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:52.674892 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f951f1c8-24ea-4a1d-bb0d-8cf4406569fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1318 microversion: 2.1 time: 0.148786 Dec 15 11:35:52.675470 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 380/757] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:52 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:52.924576 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f55fa600-4ebc-4003-b771-c9b6e96ddaf3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:52.925236 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f55fa600-4ebc-4003-b771-c9b6e96ddaf3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:52.931506 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f55fa600-4ebc-4003-b771-c9b6e96ddaf3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:52.931968 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f55fa600-4ebc-4003-b771-c9b6e96ddaf3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:52.932755 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f55fa600-4ebc-4003-b771-c9b6e96ddaf3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:52.933195 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f55fa600-4ebc-4003-b771-c9b6e96ddaf3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:53.065191 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f55fa600-4ebc-4003-b771-c9b6e96ddaf3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:53.072937 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f55fa600-4ebc-4003-b771-c9b6e96ddaf3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:53.074465 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f55fa600-4ebc-4003-b771-c9b6e96ddaf3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:53.075661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f55fa600-4ebc-4003-b771-c9b6e96ddaf3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1736 microversion: 2.20 time: 0.154987 Dec 15 11:35:53.076215 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 378/758] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:52 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:53.692065 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-aadccf2f-8081-4b61-acc5-2ce13e54aeba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:53.692658 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-aadccf2f-8081-4b61-acc5-2ce13e54aeba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:53.699541 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aadccf2f-8081-4b61-acc5-2ce13e54aeba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:53.700275 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aadccf2f-8081-4b61-acc5-2ce13e54aeba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:53.701258 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aadccf2f-8081-4b61-acc5-2ce13e54aeba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:53.701999 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aadccf2f-8081-4b61-acc5-2ce13e54aeba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:53.862982 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-aadccf2f-8081-4b61-acc5-2ce13e54aeba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:53.872775 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-aadccf2f-8081-4b61-acc5-2ce13e54aeba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1318 microversion: 2.1 time: 0.184824 Dec 15 11:35:53.874346 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 381/759] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:53 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:54.099955 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-de895a8e-26f7-4f3d-b006-3f7d8262001d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:54.102897 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-de895a8e-26f7-4f3d-b006-3f7d8262001d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:54.112528 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-de895a8e-26f7-4f3d-b006-3f7d8262001d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:54.120168 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-de895a8e-26f7-4f3d-b006-3f7d8262001d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:54.121260 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-de895a8e-26f7-4f3d-b006-3f7d8262001d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:54.121735 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-de895a8e-26f7-4f3d-b006-3f7d8262001d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:54.299581 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-de895a8e-26f7-4f3d-b006-3f7d8262001d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:54.309233 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-de895a8e-26f7-4f3d-b006-3f7d8262001d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:54.310775 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-de895a8e-26f7-4f3d-b006-3f7d8262001d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:54.311957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-de895a8e-26f7-4f3d-b006-3f7d8262001d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1736 microversion: 2.20 time: 0.218634 Dec 15 11:35:54.312846 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 379/760] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:54 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:54.890972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-168e133f-37c0-4595-bf8e-5ebeaddd9e42 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:54.893301 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-168e133f-37c0-4595-bf8e-5ebeaddd9e42 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:54.901507 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-168e133f-37c0-4595-bf8e-5ebeaddd9e42 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:54.902511 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-168e133f-37c0-4595-bf8e-5ebeaddd9e42 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:54.903355 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-168e133f-37c0-4595-bf8e-5ebeaddd9e42 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:54.903972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-168e133f-37c0-4595-bf8e-5ebeaddd9e42 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:55.066758 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-168e133f-37c0-4595-bf8e-5ebeaddd9e42 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:55.076262 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-168e133f-37c0-4595-bf8e-5ebeaddd9e42 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1318 microversion: 2.1 time: 0.189188 Dec 15 11:35:55.086112 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 382/761] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:54 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:55.329295 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fc45230b-f9de-4063-a195-97f19c89191b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:55.330702 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fc45230b-f9de-4063-a195-97f19c89191b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:55.340328 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc45230b-f9de-4063-a195-97f19c89191b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:55.341732 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc45230b-f9de-4063-a195-97f19c89191b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:55.342811 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc45230b-f9de-4063-a195-97f19c89191b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:55.343461 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc45230b-f9de-4063-a195-97f19c89191b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:55.509560 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fc45230b-f9de-4063-a195-97f19c89191b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:55.519499 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fc45230b-f9de-4063-a195-97f19c89191b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:55.523003 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fc45230b-f9de-4063-a195-97f19c89191b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:55.525253 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fc45230b-f9de-4063-a195-97f19c89191b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1736 microversion: 2.20 time: 0.199353 Dec 15 11:35:55.526336 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 380/762] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:55 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:35:55.834256 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-6c8ec1d2-5af6-4749-b3b9-8f6a8c8587eb req-29c5f160-7841-4502-b917-9d247b0e6582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc1474a-92ec-418e-9cd4-3f10cf91c8bd", "name": "network-vif-plugged", "status": "completed", "tag": "6c0ef6e9-6255-460a-8ffb-7e490afe7546"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:55.836655 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:35:55.836655 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:35:55.845786 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-6c8ec1d2-5af6-4749-b3b9-8f6a8c8587eb req-29c5f160-7841-4502-b917-9d247b0e6582 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:55.846219 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-6c8ec1d2-5af6-4749-b3b9-8f6a8c8587eb req-29c5f160-7841-4502-b917-9d247b0e6582 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:55.874469 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-6c8ec1d2-5af6-4749-b3b9-8f6a8c8587eb req-29c5f160-7841-4502-b917-9d247b0e6582 service nova] Creating event network-vif-plugged:6c0ef6e9-6255-460a-8ffb-7e490afe7546 for instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd on hv-cinder-81321 Dec 15 11:35:55.898948 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-6c8ec1d2-5af6-4749-b3b9-8f6a8c8587eb req-29c5f160-7841-4502-b917-9d247b0e6582 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157864 Dec 15 11:35:55.900433 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 383/763] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:35:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:56.098330 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c3af6153-9e94-4f66-9dfd-1e4e06867cd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:56.099347 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c3af6153-9e94-4f66-9dfd-1e4e06867cd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:56.106203 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3af6153-9e94-4f66-9dfd-1e4e06867cd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:56.107001 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3af6153-9e94-4f66-9dfd-1e4e06867cd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:56.108170 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3af6153-9e94-4f66-9dfd-1e4e06867cd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:56.108838 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3af6153-9e94-4f66-9dfd-1e4e06867cd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:56.293335 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c3af6153-9e94-4f66-9dfd-1e4e06867cd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:56.303351 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c3af6153-9e94-4f66-9dfd-1e4e06867cd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1318 microversion: 2.1 time: 0.212478 Dec 15 11:35:56.304232 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 381/764] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:56 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:35:56.546531 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-eddffb83-a9c6-4e30-8944-02c7aa18dbe1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:56.547168 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-eddffb83-a9c6-4e30-8944-02c7aa18dbe1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:56.553776 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eddffb83-a9c6-4e30-8944-02c7aa18dbe1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:56.554554 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eddffb83-a9c6-4e30-8944-02c7aa18dbe1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:56.555712 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eddffb83-a9c6-4e30-8944-02c7aa18dbe1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:56.556323 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eddffb83-a9c6-4e30-8944-02c7aa18dbe1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:56.706693 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-eddffb83-a9c6-4e30-8944-02c7aa18dbe1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:56.715670 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-eddffb83-a9c6-4e30-8944-02c7aa18dbe1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:56.721049 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-eddffb83-a9c6-4e30-8944-02c7aa18dbe1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:56.722763 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-eddffb83-a9c6-4e30-8944-02c7aa18dbe1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1736 microversion: 2.20 time: 0.180751 Dec 15 11:35:56.723546 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 384/765] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:56 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:35:57.320269 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-48420bd6-55b5-45ed-a3e9-251927f39dd2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:57.321074 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-48420bd6-55b5-45ed-a3e9-251927f39dd2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:57.327940 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-48420bd6-55b5-45ed-a3e9-251927f39dd2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:57.328862 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-48420bd6-55b5-45ed-a3e9-251927f39dd2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:57.329834 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-48420bd6-55b5-45ed-a3e9-251927f39dd2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:57.330377 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-48420bd6-55b5-45ed-a3e9-251927f39dd2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:57.497665 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-48420bd6-55b5-45ed-a3e9-251927f39dd2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:57.508800 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-48420bd6-55b5-45ed-a3e9-251927f39dd2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1318 microversion: 2.1 time: 0.192112 Dec 15 11:35:57.509384 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 382/766] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:57 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:57.742636 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-dd417271-c628-4d2c-b317-6b42e20bbafd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:57.743939 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-dd417271-c628-4d2c-b317-6b42e20bbafd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:57.750840 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dd417271-c628-4d2c-b317-6b42e20bbafd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:57.751316 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dd417271-c628-4d2c-b317-6b42e20bbafd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:57.752639 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dd417271-c628-4d2c-b317-6b42e20bbafd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:57.753152 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dd417271-c628-4d2c-b317-6b42e20bbafd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:57.916488 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-dd417271-c628-4d2c-b317-6b42e20bbafd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:57.917052 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-14306fae-ac76-4cd6-bfff-d80c175e1781 req-b10c326c-799f-4503-b667-2bbe7cfaba51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6106fc8-c8d7-4470-8d4e-a238d8bba8e3", "name": "network-vif-plugged", "status": "completed", "tag": "8b1eef73-9848-4fec-b633-d73eada19195"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:35:57.921072 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:35:57.921072 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:35:57.928116 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-dd417271-c628-4d2c-b317-6b42e20bbafd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:57.929095 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-14306fae-ac76-4cd6-bfff-d80c175e1781 req-b10c326c-799f-4503-b667-2bbe7cfaba51 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:57.929564 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-14306fae-ac76-4cd6-bfff-d80c175e1781 req-b10c326c-799f-4503-b667-2bbe7cfaba51 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:57.930840 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-dd417271-c628-4d2c-b317-6b42e20bbafd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:57.932266 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-dd417271-c628-4d2c-b317-6b42e20bbafd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1736 microversion: 2.20 time: 0.194235 Dec 15 11:35:57.944460 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 385/767] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:57 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:57.947219 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-14306fae-ac76-4cd6-bfff-d80c175e1781 req-b10c326c-799f-4503-b667-2bbe7cfaba51 service nova] Creating event network-vif-plugged:8b1eef73-9848-4fec-b633-d73eada19195 for instance f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 on hv-cinder-81321 Dec 15 11:35:57.952437 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-14306fae-ac76-4cd6-bfff-d80c175e1781 req-b10c326c-799f-4503-b667-2bbe7cfaba51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039983 Dec 15 11:35:57.953428 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 383/768] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:35:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:35:58.526181 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-da3e5cf6-4192-451d-ad1d-a51f87cb5725 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:58.526812 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-da3e5cf6-4192-451d-ad1d-a51f87cb5725 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:58.533841 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da3e5cf6-4192-451d-ad1d-a51f87cb5725 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:58.534424 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da3e5cf6-4192-451d-ad1d-a51f87cb5725 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:58.535325 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da3e5cf6-4192-451d-ad1d-a51f87cb5725 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:58.535782 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da3e5cf6-4192-451d-ad1d-a51f87cb5725 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:58.680914 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-da3e5cf6-4192-451d-ad1d-a51f87cb5725 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:58.688537 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-da3e5cf6-4192-451d-ad1d-a51f87cb5725 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1318 microversion: 2.1 time: 0.165906 Dec 15 11:35:58.689660 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 386/769] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:58 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:35:58.954279 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a909ca78-b4f0-43f2-b75e-ff60fd247d4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:58.955367 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a909ca78-b4f0-43f2-b75e-ff60fd247d4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:58.961375 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a909ca78-b4f0-43f2-b75e-ff60fd247d4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:58.964671 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a909ca78-b4f0-43f2-b75e-ff60fd247d4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:58.964671 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a909ca78-b4f0-43f2-b75e-ff60fd247d4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:58.966507 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a909ca78-b4f0-43f2-b75e-ff60fd247d4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:59.118296 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a909ca78-b4f0-43f2-b75e-ff60fd247d4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:59.132050 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a909ca78-b4f0-43f2-b75e-ff60fd247d4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:59.133758 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a909ca78-b4f0-43f2-b75e-ff60fd247d4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:59.135061 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a909ca78-b4f0-43f2-b75e-ff60fd247d4b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1736 microversion: 2.20 time: 0.187263 Dec 15 11:35:59.136101 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 384/770] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:35:58 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:35:59.704970 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bc2701d4-fdaa-4ae9-9d2e-ef3460c2f093 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:35:59.706339 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bc2701d4-fdaa-4ae9-9d2e-ef3460c2f093 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:35:59.713187 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc2701d4-fdaa-4ae9-9d2e-ef3460c2f093 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:59.713718 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc2701d4-fdaa-4ae9-9d2e-ef3460c2f093 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:59.714596 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc2701d4-fdaa-4ae9-9d2e-ef3460c2f093 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:35:59.715098 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc2701d4-fdaa-4ae9-9d2e-ef3460c2f093 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:35:59.858708 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-bc2701d4-fdaa-4ae9-9d2e-ef3460c2f093 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:35:59.867551 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bc2701d4-fdaa-4ae9-9d2e-ef3460c2f093 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1509 microversion: 2.1 time: 0.166129 Dec 15 11:35:59.868261 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 387/771] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:35:59 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:00.161804 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-18e652cf-a2b6-4a13-a677-a0ce18e8d44f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:00.162398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-18e652cf-a2b6-4a13-a677-a0ce18e8d44f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:00.168599 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18e652cf-a2b6-4a13-a677-a0ce18e8d44f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:00.169586 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18e652cf-a2b6-4a13-a677-a0ce18e8d44f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:00.170051 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18e652cf-a2b6-4a13-a677-a0ce18e8d44f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:00.181095 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-18e652cf-a2b6-4a13-a677-a0ce18e8d44f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:00.372533 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-18e652cf-a2b6-4a13-a677-a0ce18e8d44f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:00.383951 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-18e652cf-a2b6-4a13-a677-a0ce18e8d44f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:00.385768 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-18e652cf-a2b6-4a13-a677-a0ce18e8d44f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:00.386961 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-18e652cf-a2b6-4a13-a677-a0ce18e8d44f tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1736 microversion: 2.20 time: 0.233520 Dec 15 11:36:00.387520 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 385/772] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:00 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:01.315120 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4efac373-e753-4197-a9af-d8b0f3222ea2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f56283bb-2ad0-435d-8a68-9cbaf73bc5cc"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:01.317188 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4efac373-e753-4197-a9af-d8b0f3222ea2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:01.327855 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4efac373-e753-4197-a9af-d8b0f3222ea2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:01.328635 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4efac373-e753-4197-a9af-d8b0f3222ea2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:01.329901 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4efac373-e753-4197-a9af-d8b0f3222ea2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:01.330528 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4efac373-e753-4197-a9af-d8b0f3222ea2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:01.409535 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f2287a34-9025-440d-beb1-ca9bbc13fcdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:01.410827 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f2287a34-9025-440d-beb1-ca9bbc13fcdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:01.419788 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2287a34-9025-440d-beb1-ca9bbc13fcdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:01.420708 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2287a34-9025-440d-beb1-ca9bbc13fcdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:01.422829 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2287a34-9025-440d-beb1-ca9bbc13fcdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:01.423682 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2287a34-9025-440d-beb1-ca9bbc13fcdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:01.610528 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f2287a34-9025-440d-beb1-ca9bbc13fcdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:01.629589 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f2287a34-9025-440d-beb1-ca9bbc13fcdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:01.632893 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f2287a34-9025-440d-beb1-ca9bbc13fcdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:01.634047 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f2287a34-9025-440d-beb1-ca9bbc13fcdb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1736 microversion: 2.20 time: 0.228854 Dec 15 11:36:01.635121 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 386/773] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:01 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:01.798774 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4efac373-e753-4197-a9af-d8b0f3222ea2 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "POST /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.479598 Dec 15 11:36:01.822948 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 388/774] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:36:01 2021] POST /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:36:02.652589 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a3c0aaee-f0b1-44c8-9aac-e3be4b644843 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:02.653199 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a3c0aaee-f0b1-44c8-9aac-e3be4b644843 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:02.660028 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a3c0aaee-f0b1-44c8-9aac-e3be4b644843 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:02.660478 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a3c0aaee-f0b1-44c8-9aac-e3be4b644843 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:02.661255 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a3c0aaee-f0b1-44c8-9aac-e3be4b644843 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:02.661692 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a3c0aaee-f0b1-44c8-9aac-e3be4b644843 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:02.789335 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a3c0aaee-f0b1-44c8-9aac-e3be4b644843 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:02.796936 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a3c0aaee-f0b1-44c8-9aac-e3be4b644843 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:02.798467 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a3c0aaee-f0b1-44c8-9aac-e3be4b644843 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:02.799645 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a3c0aaee-f0b1-44c8-9aac-e3be4b644843 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1736 microversion: 2.20 time: 0.150794 Dec 15 11:36:02.800208 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 387/775] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:02 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:03.818778 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-73c2b7bd-727e-4f59-9ae1-91eda3abace7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:03.819466 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-73c2b7bd-727e-4f59-9ae1-91eda3abace7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:03.825593 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73c2b7bd-727e-4f59-9ae1-91eda3abace7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:03.826067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73c2b7bd-727e-4f59-9ae1-91eda3abace7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:03.826835 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73c2b7bd-727e-4f59-9ae1-91eda3abace7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:03.827262 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73c2b7bd-727e-4f59-9ae1-91eda3abace7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:03.961268 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-73c2b7bd-727e-4f59-9ae1-91eda3abace7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:03.969276 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-73c2b7bd-727e-4f59-9ae1-91eda3abace7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:03.970956 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-73c2b7bd-727e-4f59-9ae1-91eda3abace7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:03.971948 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-73c2b7bd-727e-4f59-9ae1-91eda3abace7 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1718 microversion: 2.20 time: 0.157733 Dec 15 11:36:03.972497 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 389/776] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:03 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:04.992604 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7093d53c-ccbe-4a02-991d-5aa9c0139a5a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:04.993212 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7093d53c-ccbe-4a02-991d-5aa9c0139a5a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:05.000737 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7093d53c-ccbe-4a02-991d-5aa9c0139a5a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:05.001955 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7093d53c-ccbe-4a02-991d-5aa9c0139a5a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:05.003010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7093d53c-ccbe-4a02-991d-5aa9c0139a5a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:05.003478 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7093d53c-ccbe-4a02-991d-5aa9c0139a5a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:05.146483 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7093d53c-ccbe-4a02-991d-5aa9c0139a5a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:05.154212 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7093d53c-ccbe-4a02-991d-5aa9c0139a5a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:05.155842 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7093d53c-ccbe-4a02-991d-5aa9c0139a5a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:05.157000 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7093d53c-ccbe-4a02-991d-5aa9c0139a5a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1718 microversion: 2.20 time: 0.168600 Dec 15 11:36:05.157565 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 388/777] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:04 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1718 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:06.175419 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cb4e95cf-ab0e-4fef-8f47-7001a49332a1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:06.176040 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cb4e95cf-ab0e-4fef-8f47-7001a49332a1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:06.182594 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cb4e95cf-ab0e-4fef-8f47-7001a49332a1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:06.183072 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cb4e95cf-ab0e-4fef-8f47-7001a49332a1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:06.183865 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cb4e95cf-ab0e-4fef-8f47-7001a49332a1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:06.184303 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cb4e95cf-ab0e-4fef-8f47-7001a49332a1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:06.311610 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cb4e95cf-ab0e-4fef-8f47-7001a49332a1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:06.320138 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cb4e95cf-ab0e-4fef-8f47-7001a49332a1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:06.321640 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cb4e95cf-ab0e-4fef-8f47-7001a49332a1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:06.322825 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cb4e95cf-ab0e-4fef-8f47-7001a49332a1 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1661 microversion: 2.20 time: 0.151738 Dec 15 11:36:06.323395 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 390/778] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:06 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:06.341320 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-494ba3fe-4505-4583-ac29-0b863b841d77 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "578c29d3-23e2-4201-a893-793a8d360e08"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:06.342359 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-494ba3fe-4505-4583-ac29-0b863b841d77 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:06.348457 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-494ba3fe-4505-4583-ac29-0b863b841d77 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:06.348901 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-494ba3fe-4505-4583-ac29-0b863b841d77 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:06.349676 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-494ba3fe-4505-4583-ac29-0b863b841d77 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:06.350107 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-494ba3fe-4505-4583-ac29-0b863b841d77 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:06.616214 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-494ba3fe-4505-4583-ac29-0b863b841d77 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.278859 Dec 15 11:36:06.616839 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 389/779] 10.222.0.18 () {62 vars in 1363 bytes} [Wed Dec 15 11:36:06 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/os-volume_attachments => generated 188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 11:36:06.722383 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c5a871c2-15a2-4c11-8c5c-fda7bfc19f5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:06.723093 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c5a871c2-15a2-4c11-8c5c-fda7bfc19f5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:06.729692 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c5a871c2-15a2-4c11-8c5c-fda7bfc19f5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:06.730223 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c5a871c2-15a2-4c11-8c5c-fda7bfc19f5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:06.731137 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c5a871c2-15a2-4c11-8c5c-fda7bfc19f5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:06.731703 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c5a871c2-15a2-4c11-8c5c-fda7bfc19f5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:06.947484 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c5a871c2-15a2-4c11-8c5c-fda7bfc19f5b tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/os-volume_attachments/578c29d3-23e2-4201-a893-793a8d360e08" status: 202 len: 0 microversion: 2.20 time: 0.229780 Dec 15 11:36:06.948077 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 391/780] 10.222.0.18 () {60 vars in 1456 bytes} [Wed Dec 15 11:36:06 2021] DELETE /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/os-volume_attachments/578c29d3-23e2-4201-a893-793a8d360e08 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:36:07.001396 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-854937a8-73f0-4849-acf0-2bd688fecd11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:07.001958 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-854937a8-73f0-4849-acf0-2bd688fecd11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:07.008388 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-854937a8-73f0-4849-acf0-2bd688fecd11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:07.008826 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-854937a8-73f0-4849-acf0-2bd688fecd11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:07.009592 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-854937a8-73f0-4849-acf0-2bd688fecd11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:07.010021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-854937a8-73f0-4849-acf0-2bd688fecd11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:07.089167 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-854937a8-73f0-4849-acf0-2bd688fecd11 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action" status: 202 len: 0 microversion: 2.20 time: 0.091363 Dec 15 11:36:07.089928 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 390/781] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 11:36:06 2021] POST /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:36:07.098462 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e65b07af-8482-444b-8342-5a60f85aaddb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:07.099411 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e65b07af-8482-444b-8342-5a60f85aaddb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:07.107156 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e65b07af-8482-444b-8342-5a60f85aaddb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:07.107804 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e65b07af-8482-444b-8342-5a60f85aaddb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:07.108838 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e65b07af-8482-444b-8342-5a60f85aaddb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:07.109437 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e65b07af-8482-444b-8342-5a60f85aaddb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:07.259867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e65b07af-8482-444b-8342-5a60f85aaddb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:07.268361 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e65b07af-8482-444b-8342-5a60f85aaddb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:07.269872 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e65b07af-8482-444b-8342-5a60f85aaddb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:07.271062 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e65b07af-8482-444b-8342-5a60f85aaddb tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1669 microversion: 2.20 time: 0.177038 Dec 15 11:36:07.271630 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 392/782] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:07 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:36:07.759043 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-6b2dbe78-c264-4223-93f2-1d8d924a7fdc req-09ab12ab-f7d8-4a05-ace5-16eae33c56f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc1474a-92ec-418e-9cd4-3f10cf91c8bd", "name": "network-vif-unplugged", "status": "completed", "tag": "6c0ef6e9-6255-460a-8ffb-7e490afe7546"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:07.760691 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:36:07.760691 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:36:07.768771 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-6b2dbe78-c264-4223-93f2-1d8d924a7fdc req-09ab12ab-f7d8-4a05-ace5-16eae33c56f3 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:07.769212 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-6b2dbe78-c264-4223-93f2-1d8d924a7fdc req-09ab12ab-f7d8-4a05-ace5-16eae33c56f3 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:07.780830 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-6b2dbe78-c264-4223-93f2-1d8d924a7fdc req-09ab12ab-f7d8-4a05-ace5-16eae33c56f3 service nova] Creating event network-vif-unplugged:6c0ef6e9-6255-460a-8ffb-7e490afe7546 for instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd on hv-cinder-81321 Dec 15 11:36:07.785804 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-6b2dbe78-c264-4223-93f2-1d8d924a7fdc req-09ab12ab-f7d8-4a05-ace5-16eae33c56f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030437 Dec 15 11:36:07.786458 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 391/783] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:36:07 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:36:08.287564 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-576825765", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "networks": [{"uuid": "fe7cb959-01b2-414a-bfc6-36bcac9f3cda"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:08.290664 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6c1dd7fc-6863-41fd-b110-cb1889804f00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:08.291464 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6c1dd7fc-6863-41fd-b110-cb1889804f00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:08.298257 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6c1dd7fc-6863-41fd-b110-cb1889804f00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:08.298942 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6c1dd7fc-6863-41fd-b110-cb1889804f00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:08.299727 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6c1dd7fc-6863-41fd-b110-cb1889804f00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:08.300157 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6c1dd7fc-6863-41fd-b110-cb1889804f00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:08.346235 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] validate_networks() for [('fe7cb959-01b2-414a-bfc6-36bcac9f3cda', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:36:08.435168 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6c1dd7fc-6863-41fd-b110-cb1889804f00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:08.443781 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6c1dd7fc-6863-41fd-b110-cb1889804f00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:08.445272 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6c1dd7fc-6863-41fd-b110-cb1889804f00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:08.446427 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6c1dd7fc-6863-41fd-b110-cb1889804f00 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.160439 Dec 15 11:36:08.447020 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 392/784] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:08 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:36:08.853835 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:36:08.854260 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:36:08.854800 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:36:08.855240 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:36:08.855644 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:36:08.864983 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:08.865432 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:08.866236 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:08.866695 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:08.883283 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Getting quotas for project 26b6e901a7324a01958df150d8e8562d. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:36:08.887333 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Getting quotas for user a345ca59614a4cfcae8233cf97b72e18 and project 26b6e901a7324a01958df150d8e8562d. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:36:08.899243 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:36:08.901633 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:36:08.949359 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9700d3a1-b8af-45bc-a6d9-3d324895e5f9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667227 Dec 15 11:36:08.955580 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 393/785] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:36:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:36:08.960369 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c61c956e-3c95-4e48-a162-317859909488 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:08.960981 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c61c956e-3c95-4e48-a162-317859909488 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:09.018507 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c61c956e-3c95-4e48-a162-317859909488 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:09.026683 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c61c956e-3c95-4e48-a162-317859909488 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1217 microversion: 2.1 time: 0.069846 Dec 15 11:36:09.030620 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 393/786] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:08 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:09.465181 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a1f61834-096e-4731-9757-e0e7312a0271 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:09.465788 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a1f61834-096e-4731-9757-e0e7312a0271 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:09.475142 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1f61834-096e-4731-9757-e0e7312a0271 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:09.475649 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1f61834-096e-4731-9757-e0e7312a0271 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:09.476448 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1f61834-096e-4731-9757-e0e7312a0271 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:09.476889 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1f61834-096e-4731-9757-e0e7312a0271 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:09.836024 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a1f61834-096e-4731-9757-e0e7312a0271 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:09.844980 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a1f61834-096e-4731-9757-e0e7312a0271 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:09.846659 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a1f61834-096e-4731-9757-e0e7312a0271 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:09.847834 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a1f61834-096e-4731-9757-e0e7312a0271 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.386666 Dec 15 11:36:09.848595 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 394/787] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:09 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:10.044469 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-9b49d5c3-337f-4142-bab8-3b5c14376bba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:10.045073 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-9b49d5c3-337f-4142-bab8-3b5c14376bba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:10.053299 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9b49d5c3-337f-4142-bab8-3b5c14376bba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:10.053744 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9b49d5c3-337f-4142-bab8-3b5c14376bba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:10.054526 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9b49d5c3-337f-4142-bab8-3b5c14376bba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:10.054979 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9b49d5c3-337f-4142-bab8-3b5c14376bba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:10.116358 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9b49d5c3-337f-4142-bab8-3b5c14376bba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:10.123991 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-9b49d5c3-337f-4142-bab8-3b5c14376bba tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1221 microversion: 2.1 time: 0.083895 Dec 15 11:36:10.124753 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 394/788] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:10 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:10.865715 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-186c2620-17eb-4acb-9fd0-1df998dd3479 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:10.866353 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-186c2620-17eb-4acb-9fd0-1df998dd3479 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:10.872804 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-186c2620-17eb-4acb-9fd0-1df998dd3479 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:10.873231 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-186c2620-17eb-4acb-9fd0-1df998dd3479 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:10.874014 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-186c2620-17eb-4acb-9fd0-1df998dd3479 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:10.874449 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-186c2620-17eb-4acb-9fd0-1df998dd3479 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:11.011339 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-186c2620-17eb-4acb-9fd0-1df998dd3479 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:11.019988 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-186c2620-17eb-4acb-9fd0-1df998dd3479 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:11.021473 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-186c2620-17eb-4acb-9fd0-1df998dd3479 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:11.022655 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-186c2620-17eb-4acb-9fd0-1df998dd3479 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.160682 Dec 15 11:36:11.023327 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 395/789] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:10 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:11.141077 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8873a01f-a398-4093-ba46-c41f2d6b6973 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:11.142065 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8873a01f-a398-4093-ba46-c41f2d6b6973 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:11.148498 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8873a01f-a398-4093-ba46-c41f2d6b6973 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:11.148957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8873a01f-a398-4093-ba46-c41f2d6b6973 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:11.149747 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8873a01f-a398-4093-ba46-c41f2d6b6973 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:11.150185 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8873a01f-a398-4093-ba46-c41f2d6b6973 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:11.216234 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8873a01f-a398-4093-ba46-c41f2d6b6973 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:11.224781 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8873a01f-a398-4093-ba46-c41f2d6b6973 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1221 microversion: 2.1 time: 0.087388 Dec 15 11:36:11.225363 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 395/790] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:11 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:12.041101 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1e729013-d94a-44dc-a5b0-913ef5a59dab tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:12.041927 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1e729013-d94a-44dc-a5b0-913ef5a59dab tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:12.049122 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1e729013-d94a-44dc-a5b0-913ef5a59dab tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:12.049575 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1e729013-d94a-44dc-a5b0-913ef5a59dab tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:12.050359 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1e729013-d94a-44dc-a5b0-913ef5a59dab tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:12.050821 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1e729013-d94a-44dc-a5b0-913ef5a59dab tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:12.189397 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1e729013-d94a-44dc-a5b0-913ef5a59dab tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:12.197665 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1e729013-d94a-44dc-a5b0-913ef5a59dab tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:12.199201 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1e729013-d94a-44dc-a5b0-913ef5a59dab tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:12.200364 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1e729013-d94a-44dc-a5b0-913ef5a59dab tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.163018 Dec 15 11:36:12.201153 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 396/791] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:12 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:12.241593 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6409cf02-5340-463b-8270-625a8c5989c0 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:12.242229 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6409cf02-5340-463b-8270-625a8c5989c0 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:12.248545 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6409cf02-5340-463b-8270-625a8c5989c0 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:12.249031 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6409cf02-5340-463b-8270-625a8c5989c0 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:12.249837 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6409cf02-5340-463b-8270-625a8c5989c0 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:12.250847 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6409cf02-5340-463b-8270-625a8c5989c0 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:12.310051 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6409cf02-5340-463b-8270-625a8c5989c0 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:12.317870 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6409cf02-5340-463b-8270-625a8c5989c0 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1221 microversion: 2.1 time: 0.079954 Dec 15 11:36:12.318449 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 396/792] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:12 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:13.218267 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b8ee8e6b-a0f4-4567-bec3-2afd8e100c99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:13.219455 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b8ee8e6b-a0f4-4567-bec3-2afd8e100c99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:13.226188 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8ee8e6b-a0f4-4567-bec3-2afd8e100c99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:13.226620 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8ee8e6b-a0f4-4567-bec3-2afd8e100c99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:13.227413 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8ee8e6b-a0f4-4567-bec3-2afd8e100c99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:13.227846 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8ee8e6b-a0f4-4567-bec3-2afd8e100c99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:13.334941 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2e35a670-26e3-4e38-92c8-551c27800394 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:13.335684 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2e35a670-26e3-4e38-92c8-551c27800394 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:13.342605 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e35a670-26e3-4e38-92c8-551c27800394 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:13.343051 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e35a670-26e3-4e38-92c8-551c27800394 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:13.344448 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e35a670-26e3-4e38-92c8-551c27800394 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:13.345478 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e35a670-26e3-4e38-92c8-551c27800394 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:13.367088 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b8ee8e6b-a0f4-4567-bec3-2afd8e100c99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:13.375809 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b8ee8e6b-a0f4-4567-bec3-2afd8e100c99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:13.377880 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b8ee8e6b-a0f4-4567-bec3-2afd8e100c99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:13.379506 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b8ee8e6b-a0f4-4567-bec3-2afd8e100c99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.164859 Dec 15 11:36:13.381109 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 397/793] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:13 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:13.410190 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2e35a670-26e3-4e38-92c8-551c27800394 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:13.418791 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2e35a670-26e3-4e38-92c8-551c27800394 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1221 microversion: 2.1 time: 0.087479 Dec 15 11:36:13.420112 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 397/794] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:13 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:36:14.398129 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0c09046d-59a0-4982-abb3-8e7764892803 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:14.398871 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0c09046d-59a0-4982-abb3-8e7764892803 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:14.405207 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c09046d-59a0-4982-abb3-8e7764892803 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:14.405659 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c09046d-59a0-4982-abb3-8e7764892803 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:14.407545 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c09046d-59a0-4982-abb3-8e7764892803 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:14.408159 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c09046d-59a0-4982-abb3-8e7764892803 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:14.438945 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-204e5da3-2ed9-40c3-b7e3-a2f3abc67bcd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:14.439745 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-204e5da3-2ed9-40c3-b7e3-a2f3abc67bcd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:14.446364 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-204e5da3-2ed9-40c3-b7e3-a2f3abc67bcd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:14.446943 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-204e5da3-2ed9-40c3-b7e3-a2f3abc67bcd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:14.447983 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-204e5da3-2ed9-40c3-b7e3-a2f3abc67bcd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:14.448428 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-204e5da3-2ed9-40c3-b7e3-a2f3abc67bcd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:14.523627 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-204e5da3-2ed9-40c3-b7e3-a2f3abc67bcd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:14.532695 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-204e5da3-2ed9-40c3-b7e3-a2f3abc67bcd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1221 microversion: 2.1 time: 0.098666 Dec 15 11:36:14.533287 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 398/795] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:14 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:36:14.560605 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c09046d-59a0-4982-abb3-8e7764892803 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:14.570907 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c09046d-59a0-4982-abb3-8e7764892803 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:14.572428 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c09046d-59a0-4982-abb3-8e7764892803 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:14.573778 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0c09046d-59a0-4982-abb3-8e7764892803 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.179670 Dec 15 11:36:14.574555 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 398/796] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:14 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:15.549800 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8abdbde7-81b3-444d-be7a-4abaa212b5b6 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:15.550398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8abdbde7-81b3-444d-be7a-4abaa212b5b6 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:15.557151 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8abdbde7-81b3-444d-be7a-4abaa212b5b6 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:15.557902 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8abdbde7-81b3-444d-be7a-4abaa212b5b6 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:15.559224 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8abdbde7-81b3-444d-be7a-4abaa212b5b6 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:15.559682 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8abdbde7-81b3-444d-be7a-4abaa212b5b6 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:15.601276 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0160e256-cfd2-4bfa-95a5-a208093c26e9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:15.601895 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0160e256-cfd2-4bfa-95a5-a208093c26e9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:15.612521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0160e256-cfd2-4bfa-95a5-a208093c26e9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:15.612963 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0160e256-cfd2-4bfa-95a5-a208093c26e9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:15.613753 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0160e256-cfd2-4bfa-95a5-a208093c26e9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:15.614201 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0160e256-cfd2-4bfa-95a5-a208093c26e9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:15.634446 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8abdbde7-81b3-444d-be7a-4abaa212b5b6 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:15.642298 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8abdbde7-81b3-444d-be7a-4abaa212b5b6 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1221 microversion: 2.1 time: 0.096821 Dec 15 11:36:15.643088 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 399/797] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:15 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:15.751393 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0160e256-cfd2-4bfa-95a5-a208093c26e9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:15.759183 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0160e256-cfd2-4bfa-95a5-a208093c26e9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:15.760670 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0160e256-cfd2-4bfa-95a5-a208093c26e9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:15.761826 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0160e256-cfd2-4bfa-95a5-a208093c26e9 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.172430 Dec 15 11:36:15.762722 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 399/798] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:15 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:36:16.658381 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-992ad1a9-21be-458e-8adc-9b2046e0990d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:16.659105 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-992ad1a9-21be-458e-8adc-9b2046e0990d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:16.665303 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-992ad1a9-21be-458e-8adc-9b2046e0990d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:16.665755 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-992ad1a9-21be-458e-8adc-9b2046e0990d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:16.666534 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-992ad1a9-21be-458e-8adc-9b2046e0990d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:16.666989 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-992ad1a9-21be-458e-8adc-9b2046e0990d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:16.726525 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-992ad1a9-21be-458e-8adc-9b2046e0990d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:16.736362 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-992ad1a9-21be-458e-8adc-9b2046e0990d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1221 microversion: 2.1 time: 0.081567 Dec 15 11:36:16.736946 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 400/799] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:16 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:16.780043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-826abecc-026e-4f7e-84d4-65c1cf5a8f20 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:16.781458 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-826abecc-026e-4f7e-84d4-65c1cf5a8f20 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:16.788110 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-826abecc-026e-4f7e-84d4-65c1cf5a8f20 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:16.788554 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-826abecc-026e-4f7e-84d4-65c1cf5a8f20 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:16.789360 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-826abecc-026e-4f7e-84d4-65c1cf5a8f20 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:16.789779 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-826abecc-026e-4f7e-84d4-65c1cf5a8f20 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:16.925675 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-826abecc-026e-4f7e-84d4-65c1cf5a8f20 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:16.934230 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-826abecc-026e-4f7e-84d4-65c1cf5a8f20 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:16.935830 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-826abecc-026e-4f7e-84d4-65c1cf5a8f20 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:16.939770 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-826abecc-026e-4f7e-84d4-65c1cf5a8f20 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.160760 Dec 15 11:36:16.939770 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 400/800] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:16 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:17.753844 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-cc5e3947-3468-4421-ab9f-4b55621e7d8c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:17.754503 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-cc5e3947-3468-4421-ab9f-4b55621e7d8c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:17.762281 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cc5e3947-3468-4421-ab9f-4b55621e7d8c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:17.762756 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cc5e3947-3468-4421-ab9f-4b55621e7d8c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:17.763616 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cc5e3947-3468-4421-ab9f-4b55621e7d8c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:17.764049 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-cc5e3947-3468-4421-ab9f-4b55621e7d8c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:17.828576 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-cc5e3947-3468-4421-ab9f-4b55621e7d8c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:17.836123 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-cc5e3947-3468-4421-ab9f-4b55621e7d8c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1221 microversion: 2.1 time: 0.086578 Dec 15 11:36:17.836957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 401/801] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:17 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:36:17.955076 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ae7b9407-b690-47c3-be5a-3a2662b7da06 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:17.955688 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ae7b9407-b690-47c3-be5a-3a2662b7da06 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:17.962318 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ae7b9407-b690-47c3-be5a-3a2662b7da06 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:17.962794 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ae7b9407-b690-47c3-be5a-3a2662b7da06 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:17.963572 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ae7b9407-b690-47c3-be5a-3a2662b7da06 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:17.964000 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ae7b9407-b690-47c3-be5a-3a2662b7da06 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:18.107260 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ae7b9407-b690-47c3-be5a-3a2662b7da06 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:18.115670 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ae7b9407-b690-47c3-be5a-3a2662b7da06 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:18.117148 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ae7b9407-b690-47c3-be5a-3a2662b7da06 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:18.118290 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ae7b9407-b690-47c3-be5a-3a2662b7da06 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.167046 Dec 15 11:36:18.119125 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 401/802] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:17 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:18.853304 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6920c27a-5fcd-4b1e-b764-262354bc5e28 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:18.853972 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6920c27a-5fcd-4b1e-b764-262354bc5e28 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:18.861536 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6920c27a-5fcd-4b1e-b764-262354bc5e28 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:18.861991 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6920c27a-5fcd-4b1e-b764-262354bc5e28 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:18.862850 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6920c27a-5fcd-4b1e-b764-262354bc5e28 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:18.863288 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6920c27a-5fcd-4b1e-b764-262354bc5e28 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:18.925041 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6920c27a-5fcd-4b1e-b764-262354bc5e28 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:18.933179 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6920c27a-5fcd-4b1e-b764-262354bc5e28 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1221 microversion: 2.1 time: 0.083509 Dec 15 11:36:18.933984 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 402/803] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:18 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:36:19.137174 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-02c626c3-0fc3-44bb-92d7-a537ec553ca3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:19.137783 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-02c626c3-0fc3-44bb-92d7-a537ec553ca3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:19.144818 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02c626c3-0fc3-44bb-92d7-a537ec553ca3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:19.145260 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02c626c3-0fc3-44bb-92d7-a537ec553ca3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:19.146039 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02c626c3-0fc3-44bb-92d7-a537ec553ca3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:19.146466 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02c626c3-0fc3-44bb-92d7-a537ec553ca3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:19.280424 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-02c626c3-0fc3-44bb-92d7-a537ec553ca3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:19.288938 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-02c626c3-0fc3-44bb-92d7-a537ec553ca3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:19.290445 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-02c626c3-0fc3-44bb-92d7-a537ec553ca3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:19.291679 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-02c626c3-0fc3-44bb-92d7-a537ec553ca3 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.158317 Dec 15 11:36:19.292254 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 402/804] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:19 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:19.950148 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-082a80fb-cafc-4842-8589-8cad617f7727 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:19.950784 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-082a80fb-cafc-4842-8589-8cad617f7727 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:19.957584 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-082a80fb-cafc-4842-8589-8cad617f7727 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:19.958026 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-082a80fb-cafc-4842-8589-8cad617f7727 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:19.958825 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-082a80fb-cafc-4842-8589-8cad617f7727 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:19.959257 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-082a80fb-cafc-4842-8589-8cad617f7727 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:20.016717 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-082a80fb-cafc-4842-8589-8cad617f7727 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:20.023753 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-082a80fb-cafc-4842-8589-8cad617f7727 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1221 microversion: 2.1 time: 0.077201 Dec 15 11:36:20.024302 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 403/805] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:19 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:20.311183 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-300e81ce-80dc-4347-b546-86fe6ea9f895 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:20.311747 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-300e81ce-80dc-4347-b546-86fe6ea9f895 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:20.318692 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-300e81ce-80dc-4347-b546-86fe6ea9f895 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:20.319144 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-300e81ce-80dc-4347-b546-86fe6ea9f895 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:20.319927 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-300e81ce-80dc-4347-b546-86fe6ea9f895 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:20.320362 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-300e81ce-80dc-4347-b546-86fe6ea9f895 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:20.450409 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-300e81ce-80dc-4347-b546-86fe6ea9f895 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:20.458822 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-300e81ce-80dc-4347-b546-86fe6ea9f895 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:20.460305 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-300e81ce-80dc-4347-b546-86fe6ea9f895 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:20.461710 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-300e81ce-80dc-4347-b546-86fe6ea9f895 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.154371 Dec 15 11:36:20.462274 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 403/806] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:20 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:21.040956 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-30e475c3-dd39-407a-a746-9cc35b90e81c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:21.041600 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-30e475c3-dd39-407a-a746-9cc35b90e81c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:21.048595 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-30e475c3-dd39-407a-a746-9cc35b90e81c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:21.049048 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-30e475c3-dd39-407a-a746-9cc35b90e81c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:21.049844 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-30e475c3-dd39-407a-a746-9cc35b90e81c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:21.050285 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-30e475c3-dd39-407a-a746-9cc35b90e81c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:21.109701 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-30e475c3-dd39-407a-a746-9cc35b90e81c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:21.117021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-30e475c3-dd39-407a-a746-9cc35b90e81c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1275 microversion: 2.1 time: 0.079981 Dec 15 11:36:21.117633 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 404/807] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:21 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1275 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:21.478836 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7e53a8eb-5dfb-4554-987b-fe6a84ae0bd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:21.479429 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7e53a8eb-5dfb-4554-987b-fe6a84ae0bd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:21.486283 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e53a8eb-5dfb-4554-987b-fe6a84ae0bd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:21.486769 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e53a8eb-5dfb-4554-987b-fe6a84ae0bd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:21.487555 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e53a8eb-5dfb-4554-987b-fe6a84ae0bd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:21.487987 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e53a8eb-5dfb-4554-987b-fe6a84ae0bd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:21.699068 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7e53a8eb-5dfb-4554-987b-fe6a84ae0bd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:21.707251 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7e53a8eb-5dfb-4554-987b-fe6a84ae0bd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:21.708780 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7e53a8eb-5dfb-4554-987b-fe6a84ae0bd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:21.709929 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7e53a8eb-5dfb-4554-987b-fe6a84ae0bd2 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.234766 Dec 15 11:36:21.710496 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 404/808] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:21 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:21.977373 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-08720a97-fb48-46a6-807a-bc59cc1f43b4 req-ec0a3529-7ec1-4b9f-9ff8-9ab145125ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd3853d-a075-4cd2-a933-63ad7e8e7d25", "tag": "1baa613c-7810-4c50-8aa5-1b8f154667f4"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:21.979169 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:36:21.979169 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:36:21.987157 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-08720a97-fb48-46a6-807a-bc59cc1f43b4 req-ec0a3529-7ec1-4b9f-9ff8-9ab145125ba1 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:21.987595 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-08720a97-fb48-46a6-807a-bc59cc1f43b4 req-ec0a3529-7ec1-4b9f-9ff8-9ab145125ba1 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:21.998540 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-08720a97-fb48-46a6-807a-bc59cc1f43b4 req-ec0a3529-7ec1-4b9f-9ff8-9ab145125ba1 service nova] Creating event network-changed:1baa613c-7810-4c50-8aa5-1b8f154667f4 for instance bdd3853d-a075-4cd2-a933-63ad7e8e7d25 on hv-cinder-81321 Dec 15 11:36:22.003369 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-08720a97-fb48-46a6-807a-bc59cc1f43b4 req-ec0a3529-7ec1-4b9f-9ff8-9ab145125ba1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029567 Dec 15 11:36:22.003963 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 405/809] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:36:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:36:22.134202 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0ca5719c-9251-4178-9415-b6f29847d640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:22.134837 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0ca5719c-9251-4178-9415-b6f29847d640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:22.140743 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ca5719c-9251-4178-9415-b6f29847d640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:22.141181 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ca5719c-9251-4178-9415-b6f29847d640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:22.141947 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ca5719c-9251-4178-9415-b6f29847d640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:22.142374 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ca5719c-9251-4178-9415-b6f29847d640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:22.292727 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0ca5719c-9251-4178-9415-b6f29847d640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:22.300477 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0ca5719c-9251-4178-9415-b6f29847d640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1317 microversion: 2.1 time: 0.169949 Dec 15 11:36:22.301057 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 405/810] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:22 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:22.729264 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-447aae60-e3d5-4af3-80c2-fed8ac74ba94 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:22.729969 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-447aae60-e3d5-4af3-80c2-fed8ac74ba94 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:22.736421 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-447aae60-e3d5-4af3-80c2-fed8ac74ba94 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:22.736873 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-447aae60-e3d5-4af3-80c2-fed8ac74ba94 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:22.737753 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-447aae60-e3d5-4af3-80c2-fed8ac74ba94 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:22.738163 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-447aae60-e3d5-4af3-80c2-fed8ac74ba94 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:22.873817 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-447aae60-e3d5-4af3-80c2-fed8ac74ba94 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:22.881536 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-447aae60-e3d5-4af3-80c2-fed8ac74ba94 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:22.883085 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-447aae60-e3d5-4af3-80c2-fed8ac74ba94 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:22.884237 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-447aae60-e3d5-4af3-80c2-fed8ac74ba94 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.159736 Dec 15 11:36:22.884802 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 406/811] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:22 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:23.316413 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7da322ba-12ce-4e83-a785-21e83088dbd1 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:23.317018 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7da322ba-12ce-4e83-a785-21e83088dbd1 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:23.323313 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7da322ba-12ce-4e83-a785-21e83088dbd1 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:23.323761 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7da322ba-12ce-4e83-a785-21e83088dbd1 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:23.324531 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7da322ba-12ce-4e83-a785-21e83088dbd1 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:23.324994 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7da322ba-12ce-4e83-a785-21e83088dbd1 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:23.458468 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7da322ba-12ce-4e83-a785-21e83088dbd1 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:23.465926 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7da322ba-12ce-4e83-a785-21e83088dbd1 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1317 microversion: 2.1 time: 0.153164 Dec 15 11:36:23.466492 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 406/812] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:23 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:23.902507 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e51df14c-f55c-4c5d-b4d0-0843f6b62d1c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:23.903156 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e51df14c-f55c-4c5d-b4d0-0843f6b62d1c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:23.909494 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e51df14c-f55c-4c5d-b4d0-0843f6b62d1c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:23.909937 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e51df14c-f55c-4c5d-b4d0-0843f6b62d1c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:23.910749 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e51df14c-f55c-4c5d-b4d0-0843f6b62d1c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:23.911178 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e51df14c-f55c-4c5d-b4d0-0843f6b62d1c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:24.042449 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e51df14c-f55c-4c5d-b4d0-0843f6b62d1c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:24.050843 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e51df14c-f55c-4c5d-b4d0-0843f6b62d1c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:24.052469 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e51df14c-f55c-4c5d-b4d0-0843f6b62d1c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:24.053618 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e51df14c-f55c-4c5d-b4d0-0843f6b62d1c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.155077 Dec 15 11:36:24.054169 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 407/813] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:23 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:24.483177 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-097ba9de-b50a-4b4a-b729-9b9ab7aabf55 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:24.483872 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-097ba9de-b50a-4b4a-b729-9b9ab7aabf55 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:24.490725 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-097ba9de-b50a-4b4a-b729-9b9ab7aabf55 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:24.491167 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-097ba9de-b50a-4b4a-b729-9b9ab7aabf55 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:24.491965 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-097ba9de-b50a-4b4a-b729-9b9ab7aabf55 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:24.492409 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-097ba9de-b50a-4b4a-b729-9b9ab7aabf55 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:24.624534 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-097ba9de-b50a-4b4a-b729-9b9ab7aabf55 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:24.631798 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-097ba9de-b50a-4b4a-b729-9b9ab7aabf55 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1317 microversion: 2.1 time: 0.152302 Dec 15 11:36:24.632369 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 407/814] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:24 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:25.072181 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f2f7aecd-15bc-4a64-8de1-28ec98f309a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:25.072818 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f2f7aecd-15bc-4a64-8de1-28ec98f309a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:25.079759 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2f7aecd-15bc-4a64-8de1-28ec98f309a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:25.080265 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2f7aecd-15bc-4a64-8de1-28ec98f309a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:25.081082 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2f7aecd-15bc-4a64-8de1-28ec98f309a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:25.081557 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2f7aecd-15bc-4a64-8de1-28ec98f309a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:25.213546 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f2f7aecd-15bc-4a64-8de1-28ec98f309a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:25.221641 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f2f7aecd-15bc-4a64-8de1-28ec98f309a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:25.223234 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f2f7aecd-15bc-4a64-8de1-28ec98f309a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:25.224369 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f2f7aecd-15bc-4a64-8de1-28ec98f309a5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.155885 Dec 15 11:36:25.224923 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 408/815] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:25 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:25.648830 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9e657cc2-277d-48f7-a2c2-94ae05f1dd91 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:25.649432 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9e657cc2-277d-48f7-a2c2-94ae05f1dd91 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:25.656580 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e657cc2-277d-48f7-a2c2-94ae05f1dd91 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:25.657029 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e657cc2-277d-48f7-a2c2-94ae05f1dd91 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:25.657819 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e657cc2-277d-48f7-a2c2-94ae05f1dd91 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:25.658254 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e657cc2-277d-48f7-a2c2-94ae05f1dd91 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:25.799442 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9e657cc2-277d-48f7-a2c2-94ae05f1dd91 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:25.806628 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9e657cc2-277d-48f7-a2c2-94ae05f1dd91 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1317 microversion: 2.1 time: 0.161402 Dec 15 11:36:25.807208 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 408/816] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:25 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:26.059284 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-3b3b1d5f-db96-422c-96ef-27d73c939192 req-2f55e175-d0aa-46a5-873e-cd9ed1d2a0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc1474a-92ec-418e-9cd4-3f10cf91c8bd", "name": "network-vif-plugged", "status": "completed", "tag": "6c0ef6e9-6255-460a-8ffb-7e490afe7546"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:26.060871 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:36:26.060871 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:36:26.068184 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-3b3b1d5f-db96-422c-96ef-27d73c939192 req-2f55e175-d0aa-46a5-873e-cd9ed1d2a0e4 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:26.068626 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-3b3b1d5f-db96-422c-96ef-27d73c939192 req-2f55e175-d0aa-46a5-873e-cd9ed1d2a0e4 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:26.080359 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-3b3b1d5f-db96-422c-96ef-27d73c939192 req-2f55e175-d0aa-46a5-873e-cd9ed1d2a0e4 service nova] Creating event network-vif-plugged:6c0ef6e9-6255-460a-8ffb-7e490afe7546 for instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd on hv-cinder-81321 Dec 15 11:36:26.085256 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-3b3b1d5f-db96-422c-96ef-27d73c939192 req-2f55e175-d0aa-46a5-873e-cd9ed1d2a0e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029553 Dec 15 11:36:26.086205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 409/817] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:36:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:36:26.242855 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a8e66cdf-65e4-40ee-967f-4e51709d9d99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:26.243476 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a8e66cdf-65e4-40ee-967f-4e51709d9d99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:26.250039 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8e66cdf-65e4-40ee-967f-4e51709d9d99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:26.250536 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8e66cdf-65e4-40ee-967f-4e51709d9d99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:26.251348 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8e66cdf-65e4-40ee-967f-4e51709d9d99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:26.251785 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8e66cdf-65e4-40ee-967f-4e51709d9d99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:26.413481 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a8e66cdf-65e4-40ee-967f-4e51709d9d99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:26.422148 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a8e66cdf-65e4-40ee-967f-4e51709d9d99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:26.423828 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a8e66cdf-65e4-40ee-967f-4e51709d9d99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:26.425008 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a8e66cdf-65e4-40ee-967f-4e51709d9d99 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.186202 Dec 15 11:36:26.425567 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 409/818] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:26 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:26.823129 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-359924b6-6e97-4a30-a8e0-0e7d53f1dbd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:26.823821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-359924b6-6e97-4a30-a8e0-0e7d53f1dbd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:26.830881 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-359924b6-6e97-4a30-a8e0-0e7d53f1dbd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:26.831325 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-359924b6-6e97-4a30-a8e0-0e7d53f1dbd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:26.832096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-359924b6-6e97-4a30-a8e0-0e7d53f1dbd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:26.832522 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-359924b6-6e97-4a30-a8e0-0e7d53f1dbd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:26.960071 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-359924b6-6e97-4a30-a8e0-0e7d53f1dbd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:26.967472 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-359924b6-6e97-4a30-a8e0-0e7d53f1dbd7 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1317 microversion: 2.1 time: 0.148307 Dec 15 11:36:26.968621 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 410/819] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:26 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:27.443022 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b1e986bc-4ccf-4f9f-b4e9-bbf583c95f3e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:27.443557 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b1e986bc-4ccf-4f9f-b4e9-bbf583c95f3e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:27.449724 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1e986bc-4ccf-4f9f-b4e9-bbf583c95f3e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:27.450170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1e986bc-4ccf-4f9f-b4e9-bbf583c95f3e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:27.450962 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1e986bc-4ccf-4f9f-b4e9-bbf583c95f3e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:27.451392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1e986bc-4ccf-4f9f-b4e9-bbf583c95f3e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:27.586765 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b1e986bc-4ccf-4f9f-b4e9-bbf583c95f3e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:27.595250 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b1e986bc-4ccf-4f9f-b4e9-bbf583c95f3e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:27.596719 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b1e986bc-4ccf-4f9f-b4e9-bbf583c95f3e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:27.597875 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b1e986bc-4ccf-4f9f-b4e9-bbf583c95f3e tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1727 microversion: 2.20 time: 0.158634 Dec 15 11:36:27.598441 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 410/820] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:27 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:27.986532 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f45dbfa8-768b-4249-b765-16185cfca640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:27.987214 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f45dbfa8-768b-4249-b765-16185cfca640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:27.998524 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f45dbfa8-768b-4249-b765-16185cfca640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:27.999777 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f45dbfa8-768b-4249-b765-16185cfca640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:28.000603 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f45dbfa8-768b-4249-b765-16185cfca640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:28.001078 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f45dbfa8-768b-4249-b765-16185cfca640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:28.105891 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-5377d85d-bdc8-4e46-91f3-99ce9bf94f22 req-bc626e6f-49f3-4581-9087-0571da3fdf68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd3853d-a075-4cd2-a933-63ad7e8e7d25", "name": "network-vif-plugged", "status": "completed", "tag": "1baa613c-7810-4c50-8aa5-1b8f154667f4"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:28.109219 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:36:28.109219 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:36:28.116600 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-5377d85d-bdc8-4e46-91f3-99ce9bf94f22 req-bc626e6f-49f3-4581-9087-0571da3fdf68 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:28.117037 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-5377d85d-bdc8-4e46-91f3-99ce9bf94f22 req-bc626e6f-49f3-4581-9087-0571da3fdf68 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:28.129718 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-5377d85d-bdc8-4e46-91f3-99ce9bf94f22 req-bc626e6f-49f3-4581-9087-0571da3fdf68 service nova] Creating event network-vif-plugged:1baa613c-7810-4c50-8aa5-1b8f154667f4 for instance bdd3853d-a075-4cd2-a933-63ad7e8e7d25 on hv-cinder-81321 Dec 15 11:36:28.135152 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-5377d85d-bdc8-4e46-91f3-99ce9bf94f22 req-bc626e6f-49f3-4581-9087-0571da3fdf68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033598 Dec 15 11:36:28.135746 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 411/821] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:36:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:36:28.137235 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f45dbfa8-768b-4249-b765-16185cfca640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:28.145079 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f45dbfa8-768b-4249-b765-16185cfca640 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1317 microversion: 2.1 time: 0.164144 Dec 15 11:36:28.145651 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 411/822] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:27 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:28.621776 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d6a960f0-9330-4d0a-b14f-61cb3947b10d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:28.622380 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d6a960f0-9330-4d0a-b14f-61cb3947b10d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:28.629607 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d6a960f0-9330-4d0a-b14f-61cb3947b10d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:28.630055 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d6a960f0-9330-4d0a-b14f-61cb3947b10d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:28.630839 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d6a960f0-9330-4d0a-b14f-61cb3947b10d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:28.631272 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d6a960f0-9330-4d0a-b14f-61cb3947b10d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:28.759397 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d6a960f0-9330-4d0a-b14f-61cb3947b10d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:28.767428 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d6a960f0-9330-4d0a-b14f-61cb3947b10d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:28.768902 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d6a960f0-9330-4d0a-b14f-61cb3947b10d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:28.770043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d6a960f0-9330-4d0a-b14f-61cb3947b10d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1714 microversion: 2.20 time: 0.152413 Dec 15 11:36:28.770626 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 412/823] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:36:28 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:36:29.161991 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7ff26493-9c16-4550-a5f6-0d9266e30704 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:29.162652 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7ff26493-9c16-4550-a5f6-0d9266e30704 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:29.168938 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7ff26493-9c16-4550-a5f6-0d9266e30704 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:29.169383 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7ff26493-9c16-4550-a5f6-0d9266e30704 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:29.170159 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7ff26493-9c16-4550-a5f6-0d9266e30704 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:29.170635 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7ff26493-9c16-4550-a5f6-0d9266e30704 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:29.306545 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7ff26493-9c16-4550-a5f6-0d9266e30704 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:29.313831 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7ff26493-9c16-4550-a5f6-0d9266e30704 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1317 microversion: 2.1 time: 0.155461 Dec 15 11:36:29.314390 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 412/824] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:29 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:30.330369 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bfe78d58-9d2a-4231-9042-e40a718fa244 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:30.331005 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bfe78d58-9d2a-4231-9042-e40a718fa244 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:30.337566 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bfe78d58-9d2a-4231-9042-e40a718fa244 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:30.338014 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bfe78d58-9d2a-4231-9042-e40a718fa244 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:30.338815 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bfe78d58-9d2a-4231-9042-e40a718fa244 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:30.339247 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bfe78d58-9d2a-4231-9042-e40a718fa244 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:30.470251 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-bfe78d58-9d2a-4231-9042-e40a718fa244 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:30.477662 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bfe78d58-9d2a-4231-9042-e40a718fa244 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1507 microversion: 2.1 time: 0.151001 Dec 15 11:36:30.478232 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 413/825] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:30 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:30.494294 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2d671cbb-a407-4bcb-a48c-650f6d02ddbc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f56283bb-2ad0-435d-8a68-9cbaf73bc5cc"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:30.495379 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2d671cbb-a407-4bcb-a48c-650f6d02ddbc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:30.502212 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d671cbb-a407-4bcb-a48c-650f6d02ddbc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:30.502713 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d671cbb-a407-4bcb-a48c-650f6d02ddbc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:30.503518 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d671cbb-a407-4bcb-a48c-650f6d02ddbc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:30.503946 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2d671cbb-a407-4bcb-a48c-650f6d02ddbc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:30.579082 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-2d671cbb-a407-4bcb-a48c-650f6d02ddbc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] HTTP exception thrown: Invalid volume: volume f56283bb-2ad0-435d-8a68-9cbaf73bc5cc is already attached to instances: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 Dec 15 11:36:30.579717 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2d671cbb-a407-4bcb-a48c-650f6d02ddbc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Returning 400 to user: Invalid volume: volume f56283bb-2ad0-435d-8a68-9cbaf73bc5cc is already attached to instances: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:36:30.580664 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2d671cbb-a407-4bcb-a48c-650f6d02ddbc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "POST /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090182 Dec 15 11:36:30.581215 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 413/826] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:36:30 2021] POST /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 11:36:30.638474 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ca366f05-862f-4d76-8266-e690c1fdf3f5 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:30.638998 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ca366f05-862f-4d76-8266-e690c1fdf3f5 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:30.645350 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca366f05-862f-4d76-8266-e690c1fdf3f5 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:30.645795 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca366f05-862f-4d76-8266-e690c1fdf3f5 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:30.646590 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca366f05-862f-4d76-8266-e690c1fdf3f5 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:30.647022 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca366f05-862f-4d76-8266-e690c1fdf3f5 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:30.722688 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-ca366f05-862f-4d76-8266-e690c1fdf3f5 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lazy-loading 'services' on Instance uuid f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:36:30.789570 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ca366f05-862f-4d76-8266-e690c1fdf3f5 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3/os-volume_attachments/f56283bb-2ad0-435d-8a68-9cbaf73bc5cc" status: 202 len: 0 microversion: 2.1 time: 0.154588 Dec 15 11:36:30.790221 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 414/827] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:36:30 2021] DELETE /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3/os-volume_attachments/f56283bb-2ad0-435d-8a68-9cbaf73bc5cc => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:36:30.799424 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a1c0f693-53f5-4105-aaf6-b578d4ee0dd9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:30.800482 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a1c0f693-53f5-4105-aaf6-b578d4ee0dd9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:30.807606 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a1c0f693-53f5-4105-aaf6-b578d4ee0dd9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:30.808721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a1c0f693-53f5-4105-aaf6-b578d4ee0dd9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:30.809757 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a1c0f693-53f5-4105-aaf6-b578d4ee0dd9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:30.810204 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a1c0f693-53f5-4105-aaf6-b578d4ee0dd9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:30.842497 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a1c0f693-53f5-4105-aaf6-b578d4ee0dd9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046907 Dec 15 11:36:30.843885 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 414/828] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:36:30 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:36:31.856466 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-139d4685-cf5c-41d1-b7e2-f77f2aebb537 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:31.857444 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-139d4685-cf5c-41d1-b7e2-f77f2aebb537 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:31.865563 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-139d4685-cf5c-41d1-b7e2-f77f2aebb537 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:31.866051 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-139d4685-cf5c-41d1-b7e2-f77f2aebb537 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:31.866852 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-139d4685-cf5c-41d1-b7e2-f77f2aebb537 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:31.867283 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-139d4685-cf5c-41d1-b7e2-f77f2aebb537 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:31.895231 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-139d4685-cf5c-41d1-b7e2-f77f2aebb537 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043429 Dec 15 11:36:31.895774 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 415/829] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:36:31 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:36:31.995195 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1256185638", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "networks": [{"uuid": "fe7cb959-01b2-414a-bfc6-36bcac9f3cda"}]}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:32.052847 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.network.neutron [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] validate_networks() for [('fe7cb959-01b2-414a-bfc6-36bcac9f3cda', None, None, None, None, None)] {{(pid=116082) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:36:32.471263 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Flavor limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:36:32.471681 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Image limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:36:32.472176 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Flavor pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:36:32.472576 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Image pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:36:32.473011 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:36:32.481400 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:32.481860 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:32.482745 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:32.483801 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:32.499639 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Getting quotas for project 26b6e901a7324a01958df150d8e8562d. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:36:32.503405 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Getting quotas for user a345ca59614a4cfcae8233cf97b72e18 and project 26b6e901a7324a01958df150d8e8562d. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:36:32.513763 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Going to run 1 instances... {{(pid=116082) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:36:32.516260 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116082) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:36:32.560130 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-07445848-7529-4b8d-9e3b-41ab87054a48 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568475 Dec 15 11:36:32.560769 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 415/830] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:36:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:36:32.570756 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d9fcb25a-9655-4c1f-8ef8-30f2a2f5b512 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:32.571364 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d9fcb25a-9655-4c1f-8ef8-30f2a2f5b512 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:32.625396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d9fcb25a-9655-4c1f-8ef8-30f2a2f5b512 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:32.631892 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d9fcb25a-9655-4c1f-8ef8-30f2a2f5b512 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1218 microversion: 2.1 time: 0.064730 Dec 15 11:36:32.632452 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 416/831] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:32 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:33.648676 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a5695be4-5e0a-4323-93c0-1d342ff6be61 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:33.649346 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a5695be4-5e0a-4323-93c0-1d342ff6be61 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:33.656027 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5695be4-5e0a-4323-93c0-1d342ff6be61 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:33.656465 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5695be4-5e0a-4323-93c0-1d342ff6be61 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:33.657294 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5695be4-5e0a-4323-93c0-1d342ff6be61 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:33.657730 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a5695be4-5e0a-4323-93c0-1d342ff6be61 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:33.729641 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a5695be4-5e0a-4323-93c0-1d342ff6be61 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:33.737834 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a5695be4-5e0a-4323-93c0-1d342ff6be61 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1288 microversion: 2.1 time: 0.093186 Dec 15 11:36:33.738526 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 416/832] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:33 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:34.754758 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fb17e9eb-e903-445b-9264-cdaa0bc8e578 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:34.755584 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fb17e9eb-e903-445b-9264-cdaa0bc8e578 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:34.762702 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fb17e9eb-e903-445b-9264-cdaa0bc8e578 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:34.763274 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fb17e9eb-e903-445b-9264-cdaa0bc8e578 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:34.764259 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fb17e9eb-e903-445b-9264-cdaa0bc8e578 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:34.764576 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fb17e9eb-e903-445b-9264-cdaa0bc8e578 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:34.850355 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-a2b3ac3c-d8aa-494b-a415-79f2986e2eab req-4e939042-26bd-4fe2-9607-d615d44a848f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05624cca-436c-4f44-a73b-c417795f175c", "tag": "5f6cf12c-7468-47e0-8136-bfbe7a35afdc"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:34.851999 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:36:34.851999 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:36:34.861170 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-a2b3ac3c-d8aa-494b-a415-79f2986e2eab req-4e939042-26bd-4fe2-9607-d615d44a848f service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:34.861613 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-a2b3ac3c-d8aa-494b-a415-79f2986e2eab req-4e939042-26bd-4fe2-9607-d615d44a848f service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:34.880728 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-a2b3ac3c-d8aa-494b-a415-79f2986e2eab req-4e939042-26bd-4fe2-9607-d615d44a848f service nova] Creating event network-changed:5f6cf12c-7468-47e0-8136-bfbe7a35afdc for instance 05624cca-436c-4f44-a73b-c417795f175c on hv-cinder-81321 Dec 15 11:36:34.885798 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-a2b3ac3c-d8aa-494b-a415-79f2986e2eab req-4e939042-26bd-4fe2-9607-d615d44a848f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039222 Dec 15 11:36:34.886452 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 417/833] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:36:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:36:34.969406 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fb17e9eb-e903-445b-9264-cdaa0bc8e578 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:34.978072 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fb17e9eb-e903-445b-9264-cdaa0bc8e578 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1318 microversion: 2.1 time: 0.227084 Dec 15 11:36:34.978771 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 417/834] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:34 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:35.997649 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7c3d5028-caad-4ba6-9031-dad872161a9c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:35.999221 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7c3d5028-caad-4ba6-9031-dad872161a9c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:36.005306 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c3d5028-caad-4ba6-9031-dad872161a9c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:36.005755 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c3d5028-caad-4ba6-9031-dad872161a9c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:36.006540 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c3d5028-caad-4ba6-9031-dad872161a9c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:36.007004 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c3d5028-caad-4ba6-9031-dad872161a9c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:36.134590 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7c3d5028-caad-4ba6-9031-dad872161a9c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:36.141712 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7c3d5028-caad-4ba6-9031-dad872161a9c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1318 microversion: 2.1 time: 0.148925 Dec 15 11:36:36.142271 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 418/835] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:35 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:37.158268 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-da4e1e19-c4fc-4d33-a726-1e1c339d53f8 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:37.158933 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-da4e1e19-c4fc-4d33-a726-1e1c339d53f8 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:37.165245 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da4e1e19-c4fc-4d33-a726-1e1c339d53f8 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:37.165690 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da4e1e19-c4fc-4d33-a726-1e1c339d53f8 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:37.166466 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da4e1e19-c4fc-4d33-a726-1e1c339d53f8 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:37.166926 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da4e1e19-c4fc-4d33-a726-1e1c339d53f8 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:37.294917 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-da4e1e19-c4fc-4d33-a726-1e1c339d53f8 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:37.302917 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-da4e1e19-c4fc-4d33-a726-1e1c339d53f8 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1318 microversion: 2.1 time: 0.148364 Dec 15 11:36:37.303489 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 418/836] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:37 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:38.320470 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c58627e2-580e-4af3-a50e-87d0cd277da4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:38.321080 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c58627e2-580e-4af3-a50e-87d0cd277da4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:38.327751 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c58627e2-580e-4af3-a50e-87d0cd277da4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:38.328145 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c58627e2-580e-4af3-a50e-87d0cd277da4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:38.328918 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c58627e2-580e-4af3-a50e-87d0cd277da4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:38.329355 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c58627e2-580e-4af3-a50e-87d0cd277da4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:38.462585 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c58627e2-580e-4af3-a50e-87d0cd277da4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:38.470669 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c58627e2-580e-4af3-a50e-87d0cd277da4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1318 microversion: 2.1 time: 0.153776 Dec 15 11:36:38.471257 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 419/837] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:38 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:39.488271 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b104e6ca-fcd9-467f-ad06-e8e93c20a576 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:39.488879 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b104e6ca-fcd9-467f-ad06-e8e93c20a576 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:39.495163 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b104e6ca-fcd9-467f-ad06-e8e93c20a576 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:39.495613 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b104e6ca-fcd9-467f-ad06-e8e93c20a576 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:39.496387 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b104e6ca-fcd9-467f-ad06-e8e93c20a576 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:39.496820 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b104e6ca-fcd9-467f-ad06-e8e93c20a576 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:39.622993 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b104e6ca-fcd9-467f-ad06-e8e93c20a576 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:39.630371 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b104e6ca-fcd9-467f-ad06-e8e93c20a576 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1318 microversion: 2.1 time: 0.145801 Dec 15 11:36:39.630986 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 419/838] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:39 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:39.963143 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-a20bf7cd-984f-4147-8c69-8f947955b7bd req-5ffbc18f-cb05-4326-9fb8-406c91c950b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05624cca-436c-4f44-a73b-c417795f175c", "name": "network-vif-plugged", "status": "completed", "tag": "5f6cf12c-7468-47e0-8136-bfbe7a35afdc"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:39.964749 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:36:39.964749 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:36:39.972502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-a20bf7cd-984f-4147-8c69-8f947955b7bd req-5ffbc18f-cb05-4326-9fb8-406c91c950b0 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:39.972946 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-a20bf7cd-984f-4147-8c69-8f947955b7bd req-5ffbc18f-cb05-4326-9fb8-406c91c950b0 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:39.985852 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-a20bf7cd-984f-4147-8c69-8f947955b7bd req-5ffbc18f-cb05-4326-9fb8-406c91c950b0 service nova] Creating event network-vif-plugged:5f6cf12c-7468-47e0-8136-bfbe7a35afdc for instance 05624cca-436c-4f44-a73b-c417795f175c on hv-cinder-81321 Dec 15 11:36:39.990701 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-a20bf7cd-984f-4147-8c69-8f947955b7bd req-5ffbc18f-cb05-4326-9fb8-406c91c950b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031410 Dec 15 11:36:39.991287 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 420/839] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:36:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:36:40.646955 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f617ac0e-a1d4-4446-aeb0-462efbbe8112 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:40.647565 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f617ac0e-a1d4-4446-aeb0-462efbbe8112 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:40.653803 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f617ac0e-a1d4-4446-aeb0-462efbbe8112 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:40.654835 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f617ac0e-a1d4-4446-aeb0-462efbbe8112 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:40.655975 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f617ac0e-a1d4-4446-aeb0-462efbbe8112 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:40.656419 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f617ac0e-a1d4-4446-aeb0-462efbbe8112 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:40.784963 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f617ac0e-a1d4-4446-aeb0-462efbbe8112 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:40.792323 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f617ac0e-a1d4-4446-aeb0-462efbbe8112 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1318 microversion: 2.1 time: 0.149000 Dec 15 11:36:40.792899 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 420/840] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:40 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:41.809959 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5030f1bf-b8bd-4441-85c7-c778b95d28ea tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:41.813015 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5030f1bf-b8bd-4441-85c7-c778b95d28ea tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:41.820811 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5030f1bf-b8bd-4441-85c7-c778b95d28ea tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:41.821265 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5030f1bf-b8bd-4441-85c7-c778b95d28ea tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:41.822062 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5030f1bf-b8bd-4441-85c7-c778b95d28ea tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:41.822547 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5030f1bf-b8bd-4441-85c7-c778b95d28ea tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:41.960318 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-5030f1bf-b8bd-4441-85c7-c778b95d28ea tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:41.967541 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5030f1bf-b8bd-4441-85c7-c778b95d28ea tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1508 microversion: 2.1 time: 0.162044 Dec 15 11:36:41.968100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 421/841] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:41 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:43.274717 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bd1ceb54-4182-4fc2-82e6-8d07fbee8b3e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8589e8c8-5546-4264-a89f-196c2c00dd96"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:43.275807 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bd1ceb54-4182-4fc2-82e6-8d07fbee8b3e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:43.283313 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd1ceb54-4182-4fc2-82e6-8d07fbee8b3e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:43.283802 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd1ceb54-4182-4fc2-82e6-8d07fbee8b3e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:43.284731 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd1ceb54-4182-4fc2-82e6-8d07fbee8b3e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:43.285194 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd1ceb54-4182-4fc2-82e6-8d07fbee8b3e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:43.516820 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bd1ceb54-4182-4fc2-82e6-8d07fbee8b3e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "POST /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245626 Dec 15 11:36:43.517513 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 421/842] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:36:43 2021] POST /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:36:49.804785 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c3053da1-019a-439a-9b48-d56c3d82e63a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:49.805418 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c3053da1-019a-439a-9b48-d56c3d82e63a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:49.812070 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3053da1-019a-439a-9b48-d56c3d82e63a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:49.812522 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3053da1-019a-439a-9b48-d56c3d82e63a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:49.813306 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3053da1-019a-439a-9b48-d56c3d82e63a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:49.813742 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3053da1-019a-439a-9b48-d56c3d82e63a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:49.838317 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-c3053da1-019a-439a-9b48-d56c3d82e63a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lazy-loading 'flavor' on Instance uuid ef3f31c4-e258-4bb7-a7c9-795cf3c302af {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:36:49.915053 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c3053da1-019a-439a-9b48-d56c3d82e63a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "POST /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af/action" status: 202 len: 0 microversion: 2.1 time: 0.115529 Dec 15 11:36:49.915848 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 422/843] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:36:49 2021] POST /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:36:49.926546 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-58b9f9a8-9371-468f-b216-0ea6b4e26a5e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:49.927352 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-58b9f9a8-9371-468f-b216-0ea6b4e26a5e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:49.934191 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-58b9f9a8-9371-468f-b216-0ea6b4e26a5e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:49.934655 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-58b9f9a8-9371-468f-b216-0ea6b4e26a5e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:49.935498 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-58b9f9a8-9371-468f-b216-0ea6b4e26a5e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:49.936257 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-58b9f9a8-9371-468f-b216-0ea6b4e26a5e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:50.077000 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-58b9f9a8-9371-468f-b216-0ea6b4e26a5e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:50.084999 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-58b9f9a8-9371-468f-b216-0ea6b4e26a5e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.163305 Dec 15 11:36:50.085590 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 422/844] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:49 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:50.987138 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8f3a8d2b-ef03-42ea-952b-9e355680a79b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8589e8c8-5546-4264-a89f-196c2c00dd96"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:50.988339 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8f3a8d2b-ef03-42ea-952b-9e355680a79b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:50.994818 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8f3a8d2b-ef03-42ea-952b-9e355680a79b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:50.995269 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8f3a8d2b-ef03-42ea-952b-9e355680a79b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:50.996046 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8f3a8d2b-ef03-42ea-952b-9e355680a79b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:50.996479 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8f3a8d2b-ef03-42ea-952b-9e355680a79b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:51.070849 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-8f3a8d2b-ef03-42ea-952b-9e355680a79b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] HTTP exception thrown: Invalid volume: volume 8589e8c8-5546-4264-a89f-196c2c00dd96 is already attached to instances: 05624cca-436c-4f44-a73b-c417795f175c Dec 15 11:36:51.071442 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8f3a8d2b-ef03-42ea-952b-9e355680a79b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Returning 400 to user: Invalid volume: volume 8589e8c8-5546-4264-a89f-196c2c00dd96 is already attached to instances: 05624cca-436c-4f44-a73b-c417795f175c {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:36:51.072287 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8f3a8d2b-ef03-42ea-952b-9e355680a79b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "POST /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089430 Dec 15 11:36:51.072840 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 423/845] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:36:50 2021] POST /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 11:36:51.102995 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e9856f8c-025c-4e97-b051-3569c23163bf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:51.103599 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e9856f8c-025c-4e97-b051-3569c23163bf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:51.110384 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e9856f8c-025c-4e97-b051-3569c23163bf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:51.110852 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e9856f8c-025c-4e97-b051-3569c23163bf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:51.111622 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e9856f8c-025c-4e97-b051-3569c23163bf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:51.112049 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e9856f8c-025c-4e97-b051-3569c23163bf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:51.128772 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5ad81b25-a97d-4c9d-81f3-331eb078398c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:51.129270 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5ad81b25-a97d-4c9d-81f3-331eb078398c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:51.135150 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5ad81b25-a97d-4c9d-81f3-331eb078398c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:51.135598 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5ad81b25-a97d-4c9d-81f3-331eb078398c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:51.136378 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5ad81b25-a97d-4c9d-81f3-331eb078398c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:51.136815 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5ad81b25-a97d-4c9d-81f3-331eb078398c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:51.217281 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-5ad81b25-a97d-4c9d-81f3-331eb078398c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lazy-loading 'services' on Instance uuid 05624cca-436c-4f44-a73b-c417795f175c {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:36:51.245264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e9856f8c-025c-4e97-b051-3569c23163bf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:51.252514 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e9856f8c-025c-4e97-b051-3569c23163bf tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.153151 Dec 15 11:36:51.253077 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 423/846] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:51 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:51.284544 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5ad81b25-a97d-4c9d-81f3-331eb078398c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "DELETE /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c/os-volume_attachments/8589e8c8-5546-4264-a89f-196c2c00dd96" status: 202 len: 0 microversion: 2.1 time: 0.159372 Dec 15 11:36:51.285258 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 424/847] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:36:51 2021] DELETE /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c/os-volume_attachments/8589e8c8-5546-4264-a89f-196c2c00dd96 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:36:51.293058 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-727dbce2-672c-49b5-abd0-79f984f6247c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:51.294088 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-727dbce2-672c-49b5-abd0-79f984f6247c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:51.300751 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-727dbce2-672c-49b5-abd0-79f984f6247c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:51.301537 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-727dbce2-672c-49b5-abd0-79f984f6247c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:51.301987 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-727dbce2-672c-49b5-abd0-79f984f6247c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:51.302414 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-727dbce2-672c-49b5-abd0-79f984f6247c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:51.331710 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-727dbce2-672c-49b5-abd0-79f984f6247c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042284 Dec 15 11:36:51.332268 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 424/848] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:36:51 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:36:52.270850 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-110b09ec-8a97-4c0e-ac13-1266be6f71e5 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:52.271565 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-110b09ec-8a97-4c0e-ac13-1266be6f71e5 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:52.277903 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-110b09ec-8a97-4c0e-ac13-1266be6f71e5 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:52.278350 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-110b09ec-8a97-4c0e-ac13-1266be6f71e5 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:52.279293 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-110b09ec-8a97-4c0e-ac13-1266be6f71e5 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:52.279745 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-110b09ec-8a97-4c0e-ac13-1266be6f71e5 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:52.343723 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d7e16a87-ed66-4cb1-a25d-fd0a80621ede tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:52.344666 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d7e16a87-ed66-4cb1-a25d-fd0a80621ede tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:52.350967 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d7e16a87-ed66-4cb1-a25d-fd0a80621ede tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:52.351490 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d7e16a87-ed66-4cb1-a25d-fd0a80621ede tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:52.352345 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d7e16a87-ed66-4cb1-a25d-fd0a80621ede tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:52.352853 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d7e16a87-ed66-4cb1-a25d-fd0a80621ede tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:52.382400 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d7e16a87-ed66-4cb1-a25d-fd0a80621ede tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042448 Dec 15 11:36:52.383016 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 425/849] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:36:52 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 11:36:52.417671 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-110b09ec-8a97-4c0e-ac13-1266be6f71e5 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:52.425776 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-110b09ec-8a97-4c0e-ac13-1266be6f71e5 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.159518 Dec 15 11:36:52.426329 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 425/850] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:52 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:52.478090 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-508208290", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "networks": [{"uuid": "fe7cb959-01b2-414a-bfc6-36bcac9f3cda"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:52.528723 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] validate_networks() for [('fe7cb959-01b2-414a-bfc6-36bcac9f3cda', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:36:52.886972 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:36:52.887439 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:36:52.887855 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:36:52.888326 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:36:52.888743 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:36:52.897150 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:52.897582 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:52.898378 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:52.898833 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:52.915719 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Getting quotas for project 26b6e901a7324a01958df150d8e8562d. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:36:52.920113 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Getting quotas for user a345ca59614a4cfcae8233cf97b72e18 and project 26b6e901a7324a01958df150d8e8562d. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:36:52.930412 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:36:52.932687 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:36:52.976839 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-eab0650d-9602-4809-a976-7887449341ec tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502333 Dec 15 11:36:52.977490 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 426/851] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:36:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:36:52.988193 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-27c5f4f8-479c-4894-9a5b-4a71f04494bf tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:52.988992 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-27c5f4f8-479c-4894-9a5b-4a71f04494bf tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:53.043100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-27c5f4f8-479c-4894-9a5b-4a71f04494bf tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:53.049839 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-27c5f4f8-479c-4894-9a5b-4a71f04494bf tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1217 microversion: 2.1 time: 0.065770 Dec 15 11:36:53.050407 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 426/852] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:52 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:53.442645 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f7039783-e12e-4047-a38b-943a20f8dd3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:53.443257 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f7039783-e12e-4047-a38b-943a20f8dd3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:53.449510 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f7039783-e12e-4047-a38b-943a20f8dd3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:53.449954 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f7039783-e12e-4047-a38b-943a20f8dd3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:53.451341 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f7039783-e12e-4047-a38b-943a20f8dd3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:53.451770 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f7039783-e12e-4047-a38b-943a20f8dd3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:53.605198 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f7039783-e12e-4047-a38b-943a20f8dd3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:53.613818 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f7039783-e12e-4047-a38b-943a20f8dd3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.175216 Dec 15 11:36:53.614398 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 427/853] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:53 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:54.066544 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c3b19412-a9c0-4032-a703-62a6e443f148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:54.067248 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c3b19412-a9c0-4032-a703-62a6e443f148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:54.073523 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3b19412-a9c0-4032-a703-62a6e443f148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:54.074177 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3b19412-a9c0-4032-a703-62a6e443f148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:54.075808 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3b19412-a9c0-4032-a703-62a6e443f148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:54.076255 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c3b19412-a9c0-4032-a703-62a6e443f148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:54.139033 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c3b19412-a9c0-4032-a703-62a6e443f148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:54.146283 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c3b19412-a9c0-4032-a703-62a6e443f148 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1275 microversion: 2.1 time: 0.083412 Dec 15 11:36:54.146885 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 427/854] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:54 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:54.631527 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b9c5ce0d-5a78-48c2-b66f-24199a9baa9d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:54.632276 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b9c5ce0d-5a78-48c2-b66f-24199a9baa9d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:54.639386 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9c5ce0d-5a78-48c2-b66f-24199a9baa9d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:54.640157 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9c5ce0d-5a78-48c2-b66f-24199a9baa9d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:54.641650 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9c5ce0d-5a78-48c2-b66f-24199a9baa9d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:54.642262 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9c5ce0d-5a78-48c2-b66f-24199a9baa9d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:54.883052 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b9c5ce0d-5a78-48c2-b66f-24199a9baa9d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:54.890950 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b9c5ce0d-5a78-48c2-b66f-24199a9baa9d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.263251 Dec 15 11:36:54.891809 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 428/855] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:54 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:55.164604 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-232ee1af-74ea-476b-a6a8-57c32118664d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:55.165335 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-232ee1af-74ea-476b-a6a8-57c32118664d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:55.171787 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-232ee1af-74ea-476b-a6a8-57c32118664d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:55.172239 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-232ee1af-74ea-476b-a6a8-57c32118664d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:55.173063 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-232ee1af-74ea-476b-a6a8-57c32118664d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:55.173508 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-232ee1af-74ea-476b-a6a8-57c32118664d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:55.286944 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-a5b98a05-4082-4665-aa80-623c92509094 req-ff1d3356-93fb-4f73-b963-28201037d368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28a109b-548c-434e-8c63-c2dbfdf8b6ad", "tag": "a5df6016-0907-45c4-831a-7b7e182a15dd"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:36:55.291688 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:36:55.291688 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:36:55.301156 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-a5b98a05-4082-4665-aa80-623c92509094 req-ff1d3356-93fb-4f73-b963-28201037d368 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:55.301870 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-a5b98a05-4082-4665-aa80-623c92509094 req-ff1d3356-93fb-4f73-b963-28201037d368 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:55.312266 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-232ee1af-74ea-476b-a6a8-57c32118664d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:55.316655 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-a5b98a05-4082-4665-aa80-623c92509094 req-ff1d3356-93fb-4f73-b963-28201037d368 service nova] Creating event network-changed:a5df6016-0907-45c4-831a-7b7e182a15dd for instance a28a109b-548c-434e-8c63-c2dbfdf8b6ad on hv-cinder-81321 Dec 15 11:36:55.321810 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-a5b98a05-4082-4665-aa80-623c92509094 req-ff1d3356-93fb-4f73-b963-28201037d368 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040077 Dec 15 11:36:55.322411 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 429/856] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:36:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:36:55.327555 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-232ee1af-74ea-476b-a6a8-57c32118664d tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1317 microversion: 2.1 time: 0.166896 Dec 15 11:36:55.328123 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 428/857] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:55 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:55.909963 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-067361f8-18ef-4627-971e-f3d5814e6cbc tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:55.910734 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-067361f8-18ef-4627-971e-f3d5814e6cbc tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:55.917530 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-067361f8-18ef-4627-971e-f3d5814e6cbc tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:55.918285 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-067361f8-18ef-4627-971e-f3d5814e6cbc tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:55.919948 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-067361f8-18ef-4627-971e-f3d5814e6cbc tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:55.920388 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-067361f8-18ef-4627-971e-f3d5814e6cbc tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:56.184144 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-067361f8-18ef-4627-971e-f3d5814e6cbc tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:56.192091 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-067361f8-18ef-4627-971e-f3d5814e6cbc tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.286227 Dec 15 11:36:56.193020 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 430/858] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:55 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:56.344681 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8bac1e6e-a54b-420c-8cef-3912061e7469 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:56.345293 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8bac1e6e-a54b-420c-8cef-3912061e7469 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:56.351543 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8bac1e6e-a54b-420c-8cef-3912061e7469 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:56.351992 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8bac1e6e-a54b-420c-8cef-3912061e7469 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:56.352777 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8bac1e6e-a54b-420c-8cef-3912061e7469 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:56.353214 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8bac1e6e-a54b-420c-8cef-3912061e7469 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:56.486972 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8bac1e6e-a54b-420c-8cef-3912061e7469 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:56.494297 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8bac1e6e-a54b-420c-8cef-3912061e7469 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1317 microversion: 2.1 time: 0.153991 Dec 15 11:36:56.494904 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 429/859] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:56 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:57.210312 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-19e497ed-ec86-424b-b2ab-92d3ae4377e3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:57.210962 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-19e497ed-ec86-424b-b2ab-92d3ae4377e3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:57.217304 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19e497ed-ec86-424b-b2ab-92d3ae4377e3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:57.217769 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19e497ed-ec86-424b-b2ab-92d3ae4377e3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:57.218541 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19e497ed-ec86-424b-b2ab-92d3ae4377e3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:57.218998 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19e497ed-ec86-424b-b2ab-92d3ae4377e3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:57.356329 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-19e497ed-ec86-424b-b2ab-92d3ae4377e3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:57.363659 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-19e497ed-ec86-424b-b2ab-92d3ae4377e3 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.157263 Dec 15 11:36:57.364226 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 431/860] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:57 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:57.511243 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-07be8eb4-47cf-417f-9e05-7b4f080edf73 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:57.511855 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-07be8eb4-47cf-417f-9e05-7b4f080edf73 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:57.519052 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07be8eb4-47cf-417f-9e05-7b4f080edf73 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:57.519497 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07be8eb4-47cf-417f-9e05-7b4f080edf73 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:57.520296 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07be8eb4-47cf-417f-9e05-7b4f080edf73 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:57.520735 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07be8eb4-47cf-417f-9e05-7b4f080edf73 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:57.648398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-07be8eb4-47cf-417f-9e05-7b4f080edf73 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:57.655763 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-07be8eb4-47cf-417f-9e05-7b4f080edf73 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1317 microversion: 2.1 time: 0.148087 Dec 15 11:36:57.656432 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 430/861] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:57 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:58.381094 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f8a535e9-14d5-40bd-aa1d-8e7c1bdbd461 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:58.381668 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f8a535e9-14d5-40bd-aa1d-8e7c1bdbd461 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:58.388567 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8a535e9-14d5-40bd-aa1d-8e7c1bdbd461 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:58.389043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8a535e9-14d5-40bd-aa1d-8e7c1bdbd461 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:58.389818 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8a535e9-14d5-40bd-aa1d-8e7c1bdbd461 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:58.390245 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8a535e9-14d5-40bd-aa1d-8e7c1bdbd461 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:58.520523 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f8a535e9-14d5-40bd-aa1d-8e7c1bdbd461 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:58.528599 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f8a535e9-14d5-40bd-aa1d-8e7c1bdbd461 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.150595 Dec 15 11:36:58.529231 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 432/862] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:58 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:58.673566 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5342ed70-496b-4cdb-8cc2-0fee62c4ad59 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:58.674113 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5342ed70-496b-4cdb-8cc2-0fee62c4ad59 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:58.680540 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5342ed70-496b-4cdb-8cc2-0fee62c4ad59 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:58.680988 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5342ed70-496b-4cdb-8cc2-0fee62c4ad59 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:58.681794 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5342ed70-496b-4cdb-8cc2-0fee62c4ad59 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:58.682228 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5342ed70-496b-4cdb-8cc2-0fee62c4ad59 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:58.812406 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-5342ed70-496b-4cdb-8cc2-0fee62c4ad59 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:58.820675 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5342ed70-496b-4cdb-8cc2-0fee62c4ad59 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1317 microversion: 2.1 time: 0.150861 Dec 15 11:36:58.821240 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 431/863] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:58 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:59.545105 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e2c51a1a-0ef3-4190-b1af-721f8a93d0c2 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:59.545710 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e2c51a1a-0ef3-4190-b1af-721f8a93d0c2 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:59.551968 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e2c51a1a-0ef3-4190-b1af-721f8a93d0c2 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:59.552414 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e2c51a1a-0ef3-4190-b1af-721f8a93d0c2 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:59.553195 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e2c51a1a-0ef3-4190-b1af-721f8a93d0c2 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:59.553630 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e2c51a1a-0ef3-4190-b1af-721f8a93d0c2 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:59.685250 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e2c51a1a-0ef3-4190-b1af-721f8a93d0c2 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:59.692658 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e2c51a1a-0ef3-4190-b1af-721f8a93d0c2 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.151304 Dec 15 11:36:59.693236 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 433/864] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:59 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:36:59.838448 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-20d0c071-3551-403a-9df4-22cc25ba24fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:36:59.839190 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-20d0c071-3551-403a-9df4-22cc25ba24fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:36:59.846417 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-20d0c071-3551-403a-9df4-22cc25ba24fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:59.846886 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-20d0c071-3551-403a-9df4-22cc25ba24fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:59.847663 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-20d0c071-3551-403a-9df4-22cc25ba24fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:36:59.848147 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-20d0c071-3551-403a-9df4-22cc25ba24fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:36:59.979042 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-20d0c071-3551-403a-9df4-22cc25ba24fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:36:59.986661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-20d0c071-3551-403a-9df4-22cc25ba24fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1317 microversion: 2.1 time: 0.151866 Dec 15 11:36:59.987239 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 432/865] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:36:59 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:00.055352 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-465d5d39-c1b6-4d1d-b900-0654b8f29666 req-4f116329-980a-4a2e-a7ff-5a5f345d6e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28a109b-548c-434e-8c63-c2dbfdf8b6ad", "name": "network-vif-plugged", "status": "completed", "tag": "a5df6016-0907-45c4-831a-7b7e182a15dd"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:00.057484 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:00.057484 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:37:00.065917 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-465d5d39-c1b6-4d1d-b900-0654b8f29666 req-4f116329-980a-4a2e-a7ff-5a5f345d6e71 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:00.066582 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-465d5d39-c1b6-4d1d-b900-0654b8f29666 req-4f116329-980a-4a2e-a7ff-5a5f345d6e71 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:00.078842 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-465d5d39-c1b6-4d1d-b900-0654b8f29666 req-4f116329-980a-4a2e-a7ff-5a5f345d6e71 service nova] Creating event network-vif-plugged:a5df6016-0907-45c4-831a-7b7e182a15dd for instance a28a109b-548c-434e-8c63-c2dbfdf8b6ad on hv-cinder-81321 Dec 15 11:37:00.084191 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-465d5d39-c1b6-4d1d-b900-0654b8f29666 req-4f116329-980a-4a2e-a7ff-5a5f345d6e71 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032189 Dec 15 11:37:00.085037 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 434/866] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:00.709380 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-c584fd1e-375c-478a-81da-0a521ab37fdd tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:00.710034 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-c584fd1e-375c-478a-81da-0a521ab37fdd tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:00.716275 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c584fd1e-375c-478a-81da-0a521ab37fdd tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:00.716729 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c584fd1e-375c-478a-81da-0a521ab37fdd tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:00.717599 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c584fd1e-375c-478a-81da-0a521ab37fdd tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:00.718039 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-c584fd1e-375c-478a-81da-0a521ab37fdd tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:00.847754 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-c584fd1e-375c-478a-81da-0a521ab37fdd tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:00.856599 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-c584fd1e-375c-478a-81da-0a521ab37fdd tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.150539 Dec 15 11:37:00.857521 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 433/867] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:00 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:01.004040 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6613fd40-dae8-4327-977a-9488efed176b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:01.004655 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6613fd40-dae8-4327-977a-9488efed176b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:01.011050 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6613fd40-dae8-4327-977a-9488efed176b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:01.011574 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6613fd40-dae8-4327-977a-9488efed176b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:01.012783 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6613fd40-dae8-4327-977a-9488efed176b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:01.013251 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6613fd40-dae8-4327-977a-9488efed176b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:01.143309 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6613fd40-dae8-4327-977a-9488efed176b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:01.151033 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6613fd40-dae8-4327-977a-9488efed176b tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1317 microversion: 2.1 time: 0.151004 Dec 15 11:37:01.151673 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 435/868] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:00 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:01.873380 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-852fd77e-42cd-4a06-8395-a5be52c0afb4 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:01.873981 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-852fd77e-42cd-4a06-8395-a5be52c0afb4 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:01.880235 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-852fd77e-42cd-4a06-8395-a5be52c0afb4 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:01.880678 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-852fd77e-42cd-4a06-8395-a5be52c0afb4 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:01.881444 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-852fd77e-42cd-4a06-8395-a5be52c0afb4 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:01.881871 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-852fd77e-42cd-4a06-8395-a5be52c0afb4 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:02.028248 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-852fd77e-42cd-4a06-8395-a5be52c0afb4 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:02.036124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-852fd77e-42cd-4a06-8395-a5be52c0afb4 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.166842 Dec 15 11:37:02.036902 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 434/869] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:01 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:02.168948 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1a480ce6-be1c-42a1-9ceb-f78c36b68d3f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:02.169619 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1a480ce6-be1c-42a1-9ceb-f78c36b68d3f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:02.176131 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a480ce6-be1c-42a1-9ceb-f78c36b68d3f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:02.176756 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a480ce6-be1c-42a1-9ceb-f78c36b68d3f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:02.177537 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a480ce6-be1c-42a1-9ceb-f78c36b68d3f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:02.177968 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a480ce6-be1c-42a1-9ceb-f78c36b68d3f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:02.321920 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1a480ce6-be1c-42a1-9ceb-f78c36b68d3f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:02.329411 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1a480ce6-be1c-42a1-9ceb-f78c36b68d3f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1508 microversion: 2.1 time: 0.164732 Dec 15 11:37:02.329984 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 436/870] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:02 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:03.053560 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6477ec6b-ab59-41e0-89d2-2d1c787c52a6 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:03.054169 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6477ec6b-ab59-41e0-89d2-2d1c787c52a6 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:03.060429 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6477ec6b-ab59-41e0-89d2-2d1c787c52a6 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:03.060873 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6477ec6b-ab59-41e0-89d2-2d1c787c52a6 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:03.061649 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6477ec6b-ab59-41e0-89d2-2d1c787c52a6 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:03.062096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6477ec6b-ab59-41e0-89d2-2d1c787c52a6 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:03.192776 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6477ec6b-ab59-41e0-89d2-2d1c787c52a6 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:03.200792 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6477ec6b-ab59-41e0-89d2-2d1c787c52a6 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.150877 Dec 15 11:37:03.201348 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 435/871] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:03 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:03.650148 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-57571bc3-9525-459c-ba38-a22cd5284967 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aee343f5-e2c9-49fd-b25f-778d6f6eab1e"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:03.651299 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-57571bc3-9525-459c-ba38-a22cd5284967 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:03.657746 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57571bc3-9525-459c-ba38-a22cd5284967 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:03.658212 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57571bc3-9525-459c-ba38-a22cd5284967 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:03.659261 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57571bc3-9525-459c-ba38-a22cd5284967 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:03.659770 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57571bc3-9525-459c-ba38-a22cd5284967 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:03.914264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-57571bc3-9525-459c-ba38-a22cd5284967 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "POST /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268900 Dec 15 11:37:03.914931 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 437/872] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:37:03 2021] POST /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:04.217141 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d5097089-5eaa-42ef-b70a-b6788ddc648e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:04.217754 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d5097089-5eaa-42ef-b70a-b6788ddc648e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:04.224248 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d5097089-5eaa-42ef-b70a-b6788ddc648e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:04.224738 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d5097089-5eaa-42ef-b70a-b6788ddc648e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:04.225546 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d5097089-5eaa-42ef-b70a-b6788ddc648e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:04.225980 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d5097089-5eaa-42ef-b70a-b6788ddc648e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:04.363628 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-d5097089-5eaa-42ef-b70a-b6788ddc648e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:04.370917 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d5097089-5eaa-42ef-b70a-b6788ddc648e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.157655 Dec 15 11:37:04.371646 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 436/873] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:04 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:05.389472 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7cb891fa-be4c-4f44-8a0e-b0302bc08881 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:05.390075 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7cb891fa-be4c-4f44-8a0e-b0302bc08881 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:05.396518 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7cb891fa-be4c-4f44-8a0e-b0302bc08881 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:05.396963 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7cb891fa-be4c-4f44-8a0e-b0302bc08881 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:05.397746 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7cb891fa-be4c-4f44-8a0e-b0302bc08881 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:05.398179 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7cb891fa-be4c-4f44-8a0e-b0302bc08881 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:05.642559 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7cb891fa-be4c-4f44-8a0e-b0302bc08881 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:05.650094 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7cb891fa-be4c-4f44-8a0e-b0302bc08881 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.265290 Dec 15 11:37:05.650862 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 438/874] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:05 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:06.667665 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-42245c0f-9942-42d4-a637-2e7bc466d16f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:06.668979 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-42245c0f-9942-42d4-a637-2e7bc466d16f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:06.674944 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-42245c0f-9942-42d4-a637-2e7bc466d16f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:06.675396 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-42245c0f-9942-42d4-a637-2e7bc466d16f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:06.676177 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-42245c0f-9942-42d4-a637-2e7bc466d16f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:06.676616 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-42245c0f-9942-42d4-a637-2e7bc466d16f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:06.807839 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-42245c0f-9942-42d4-a637-2e7bc466d16f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:06.816127 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-42245c0f-9942-42d4-a637-2e7bc466d16f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.152323 Dec 15 11:37:06.816704 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 437/875] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:06 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:07.833118 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d5d4f99b-63ac-4be4-84e7-fa5fc2b10c3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:07.833987 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d5d4f99b-63ac-4be4-84e7-fa5fc2b10c3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:07.840908 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d5d4f99b-63ac-4be4-84e7-fa5fc2b10c3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:07.841359 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d5d4f99b-63ac-4be4-84e7-fa5fc2b10c3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:07.842132 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d5d4f99b-63ac-4be4-84e7-fa5fc2b10c3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:07.842584 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d5d4f99b-63ac-4be4-84e7-fa5fc2b10c3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:07.974272 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d5d4f99b-63ac-4be4-84e7-fa5fc2b10c3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:07.982537 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d5d4f99b-63ac-4be4-84e7-fa5fc2b10c3c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.153094 Dec 15 11:37:07.983132 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 439/876] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:07 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:08.124880 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-15055aaa-3382-47ed-94ce-7d0a0f61773c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:08.125854 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-15055aaa-3382-47ed-94ce-7d0a0f61773c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:08.132169 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-15055aaa-3382-47ed-94ce-7d0a0f61773c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:08.132615 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-15055aaa-3382-47ed-94ce-7d0a0f61773c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:08.133392 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-15055aaa-3382-47ed-94ce-7d0a0f61773c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:08.134059 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-15055aaa-3382-47ed-94ce-7d0a0f61773c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:08.165767 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-15055aaa-3382-47ed-94ce-7d0a0f61773c tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044577 Dec 15 11:37:08.166343 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 438/877] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 11:37:08 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:08.231342 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f04ce58f-56b0-49c1-a5e3-dc24f3dc8811 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:08.231743 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f04ce58f-56b0-49c1-a5e3-dc24f3dc8811 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:08.237557 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f04ce58f-56b0-49c1-a5e3-dc24f3dc8811 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:08.238005 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f04ce58f-56b0-49c1-a5e3-dc24f3dc8811 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:08.238820 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f04ce58f-56b0-49c1-a5e3-dc24f3dc8811 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:08.239257 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f04ce58f-56b0-49c1-a5e3-dc24f3dc8811 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:08.265985 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f04ce58f-56b0-49c1-a5e3-dc24f3dc8811 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:37:08.343521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f04ce58f-56b0-49c1-a5e3-dc24f3dc8811 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 204 len: 0 microversion: 2.20 time: 0.115795 Dec 15 11:37:08.344097 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 440/878] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 11:37:08 2021] DELETE /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 11:37:08.352438 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-9bf3bac0-ef7a-45bd-92e8-90b44dce7062 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:08.353047 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-9bf3bac0-ef7a-45bd-92e8-90b44dce7062 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:08.358976 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9bf3bac0-ef7a-45bd-92e8-90b44dce7062 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:08.359425 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9bf3bac0-ef7a-45bd-92e8-90b44dce7062 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:08.360198 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9bf3bac0-ef7a-45bd-92e8-90b44dce7062 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:08.360632 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-9bf3bac0-ef7a-45bd-92e8-90b44dce7062 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:08.500334 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9bf3bac0-ef7a-45bd-92e8-90b44dce7062 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:08.508340 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9bf3bac0-ef7a-45bd-92e8-90b44dce7062 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:08.509843 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-9bf3bac0-ef7a-45bd-92e8-90b44dce7062 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:08.511029 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-9bf3bac0-ef7a-45bd-92e8-90b44dce7062 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.162352 Dec 15 11:37:08.511695 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 439/879] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:37:08 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:37:09.001181 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7a652b17-b142-49fd-b571-309380cb6061 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:09.001871 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7a652b17-b142-49fd-b571-309380cb6061 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:09.008050 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7a652b17-b142-49fd-b571-309380cb6061 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:09.008489 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7a652b17-b142-49fd-b571-309380cb6061 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:09.009360 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7a652b17-b142-49fd-b571-309380cb6061 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:09.009795 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7a652b17-b142-49fd-b571-309380cb6061 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:09.147406 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7a652b17-b142-49fd-b571-309380cb6061 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:09.155422 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7a652b17-b142-49fd-b571-309380cb6061 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1509 microversion: 2.1 time: 0.158250 Dec 15 11:37:09.155987 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 441/880] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:08 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:09.171989 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fc324092-720a-4bee-a41f-81f7e3bafec7 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:09.172554 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fc324092-720a-4bee-a41f-81f7e3bafec7 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:09.180091 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc324092-720a-4bee-a41f-81f7e3bafec7 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:09.180689 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc324092-720a-4bee-a41f-81f7e3bafec7 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:09.182064 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc324092-720a-4bee-a41f-81f7e3bafec7 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:09.182064 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fc324092-720a-4bee-a41f-81f7e3bafec7 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:09.263360 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fc324092-720a-4bee-a41f-81f7e3bafec7 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "POST /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af/action" status: 202 len: 0 microversion: 2.1 time: 0.095594 Dec 15 11:37:09.263872 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 440/881] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 11:37:09 2021] POST /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:37:09.272262 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d89a26d5-f920-4c88-945a-b3ff552e1936 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:09.272875 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d89a26d5-f920-4c88-945a-b3ff552e1936 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:09.279668 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d89a26d5-f920-4c88-945a-b3ff552e1936 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:09.280199 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d89a26d5-f920-4c88-945a-b3ff552e1936 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:09.281078 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d89a26d5-f920-4c88-945a-b3ff552e1936 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:09.281519 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d89a26d5-f920-4c88-945a-b3ff552e1936 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:09.419288 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d89a26d5-f920-4c88-945a-b3ff552e1936 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:09.426739 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d89a26d5-f920-4c88-945a-b3ff552e1936 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1517 microversion: 2.1 time: 0.158579 Dec 15 11:37:09.427309 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 442/882] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:09 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:09.531222 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2e5e0890-9364-4dfa-9d63-6b15d619c770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:09.531847 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2e5e0890-9364-4dfa-9d63-6b15d619c770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:09.538701 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e5e0890-9364-4dfa-9d63-6b15d619c770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:09.539159 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e5e0890-9364-4dfa-9d63-6b15d619c770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:09.539952 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e5e0890-9364-4dfa-9d63-6b15d619c770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:09.540391 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2e5e0890-9364-4dfa-9d63-6b15d619c770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:09.678717 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2e5e0890-9364-4dfa-9d63-6b15d619c770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:09.686660 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2e5e0890-9364-4dfa-9d63-6b15d619c770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:09.688172 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2e5e0890-9364-4dfa-9d63-6b15d619c770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:09.689317 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2e5e0890-9364-4dfa-9d63-6b15d619c770 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1720 microversion: 2.20 time: 0.162412 Dec 15 11:37:09.689896 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 441/883] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:37:09 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:37:10.444039 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4143474d-0295-4cbe-b979-b83a36e216b1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:10.444870 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4143474d-0295-4cbe-b979-b83a36e216b1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:10.451569 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4143474d-0295-4cbe-b979-b83a36e216b1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:10.452009 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4143474d-0295-4cbe-b979-b83a36e216b1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:10.452799 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4143474d-0295-4cbe-b979-b83a36e216b1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:10.453469 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4143474d-0295-4cbe-b979-b83a36e216b1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:10.709264 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-472ce404-aeab-44b0-bb24-a9e612d389d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:10.710026 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-472ce404-aeab-44b0-bb24-a9e612d389d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:10.717167 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-472ce404-aeab-44b0-bb24-a9e612d389d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:10.717608 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-472ce404-aeab-44b0-bb24-a9e612d389d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:10.718389 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-472ce404-aeab-44b0-bb24-a9e612d389d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:10.718899 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-472ce404-aeab-44b0-bb24-a9e612d389d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:10.752877 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4143474d-0295-4cbe-b979-b83a36e216b1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:10.760914 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4143474d-0295-4cbe-b979-b83a36e216b1 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1519 microversion: 2.1 time: 0.320528 Dec 15 11:37:10.761816 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 443/884] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:10 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1519 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:37:10.786407 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-472ce404-aeab-44b0-bb24-a9e612d389d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:10.797108 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-472ce404-aeab-44b0-bb24-a9e612d389d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:10.798879 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-472ce404-aeab-44b0-bb24-a9e612d389d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:10.800100 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-472ce404-aeab-44b0-bb24-a9e612d389d5 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1653 microversion: 2.20 time: 0.094930 Dec 15 11:37:10.800974 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 442/885] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:37:10 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1653 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 11:37:10.963145 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-06b3cec6-04d7-414c-830f-0d7c051e07bc req-9fc7f77e-1097-4c9c-8aff-538091f1c69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc1474a-92ec-418e-9cd4-3f10cf91c8bd", "name": "network-vif-deleted", "tag": "6c0ef6e9-6255-460a-8ffb-7e490afe7546"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:10.965239 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:10.965239 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:37:10.977561 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-06b3cec6-04d7-414c-830f-0d7c051e07bc req-9fc7f77e-1097-4c9c-8aff-538091f1c69c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:10.979001 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-06b3cec6-04d7-414c-830f-0d7c051e07bc req-9fc7f77e-1097-4c9c-8aff-538091f1c69c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:11.005392 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-06b3cec6-04d7-414c-830f-0d7c051e07bc req-9fc7f77e-1097-4c9c-8aff-538091f1c69c service nova] Creating event network-vif-deleted:6c0ef6e9-6255-460a-8ffb-7e490afe7546 for instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd on hv-cinder-81321 Dec 15 11:37:11.012369 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-06b3cec6-04d7-414c-830f-0d7c051e07bc req-9fc7f77e-1097-4c9c-8aff-538091f1c69c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050866 Dec 15 11:37:11.019045 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 444/886] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:11.490236 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-27abb671-d172-4d92-b27b-e8f2c2d592d4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:11.490874 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-27abb671-d172-4d92-b27b-e8f2c2d592d4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:11.497235 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-27abb671-d172-4d92-b27b-e8f2c2d592d4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:11.497820 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-27abb671-d172-4d92-b27b-e8f2c2d592d4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:11.498789 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-27abb671-d172-4d92-b27b-e8f2c2d592d4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:11.499340 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-27abb671-d172-4d92-b27b-e8f2c2d592d4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:11.587619 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-27abb671-d172-4d92-b27b-e8f2c2d592d4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lazy-loading 'services' on Instance uuid a28a109b-548c-434e-8c63-c2dbfdf8b6ad {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:37:11.661554 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-27abb671-d172-4d92-b27b-e8f2c2d592d4 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad/os-volume_attachments/aee343f5-e2c9-49fd-b25f-778d6f6eab1e" status: 202 len: 0 microversion: 2.1 time: 0.174997 Dec 15 11:37:11.663219 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 443/887] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:37:11 2021] DELETE /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad/os-volume_attachments/aee343f5-e2c9-49fd-b25f-778d6f6eab1e => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:37:11.673592 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-899bc74c-f759-45ac-815b-e2d4d18faa6f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:11.675857 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-899bc74c-f759-45ac-815b-e2d4d18faa6f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:11.687607 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-899bc74c-f759-45ac-815b-e2d4d18faa6f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:11.688566 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-899bc74c-f759-45ac-815b-e2d4d18faa6f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:11.689787 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-899bc74c-f759-45ac-815b-e2d4d18faa6f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:11.690358 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-899bc74c-f759-45ac-815b-e2d4d18faa6f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:11.729362 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-899bc74c-f759-45ac-815b-e2d4d18faa6f tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061350 Dec 15 11:37:11.729976 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 445/888] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:37:11 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:37:11.782045 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-05e8dd0c-6fca-4b23-a666-4a354ae4312d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:11.782950 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-05e8dd0c-6fca-4b23-a666-4a354ae4312d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:11.796919 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-05e8dd0c-6fca-4b23-a666-4a354ae4312d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:11.799386 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-05e8dd0c-6fca-4b23-a666-4a354ae4312d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:11.800475 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-05e8dd0c-6fca-4b23-a666-4a354ae4312d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:11.805499 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-05e8dd0c-6fca-4b23-a666-4a354ae4312d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:11.819478 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:11.820137 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:11.834043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:11.834880 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:11.837999 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:11.838717 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:11.890960 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:11.891832 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:11.892499 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lazy-loading 'fault' on Instance uuid 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:37:11.948821 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:11.956812 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:11.958614 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f55f136acecb40ed90a41911e05aa10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1091f449b1dd4715bfc08ff209ce29fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:11.959751 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cf4c54b5-2635-4919-b658-0cc3e744432d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 200 len: 1371 microversion: 2.20 time: 0.144262 Dec 15 11:37:11.960312 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 446/889] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:37:11 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 11:37:11.996263 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-05e8dd0c-6fca-4b23-a666-4a354ae4312d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:12.005994 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-05e8dd0c-6fca-4b23-a666-4a354ae4312d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1575 microversion: 2.1 time: 0.230051 Dec 15 11:37:12.007584 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 444/890] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:11 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:12.079485 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-4374a1a9-af82-4927-99e9-d6d928d2e608 req-ec58ab2f-5e84-4091-9cc2-9e6db8718bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3f31c4-e258-4bb7-a7c9-795cf3c302af", "name": "network-vif-unplugged", "status": "completed", "tag": "fdd01109-ae47-4e03-a1ac-0a3119e113ea"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:12.081562 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:12.081562 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:37:12.092120 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-4374a1a9-af82-4927-99e9-d6d928d2e608 req-ec58ab2f-5e84-4091-9cc2-9e6db8718bad service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:12.092693 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-4374a1a9-af82-4927-99e9-d6d928d2e608 req-ec58ab2f-5e84-4091-9cc2-9e6db8718bad service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:12.105294 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-4374a1a9-af82-4927-99e9-d6d928d2e608 req-ec58ab2f-5e84-4091-9cc2-9e6db8718bad service nova] Creating event network-vif-unplugged:fdd01109-ae47-4e03-a1ac-0a3119e113ea for instance ef3f31c4-e258-4bb7-a7c9-795cf3c302af on hv-cinder-81321 Dec 15 11:37:12.111172 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-4374a1a9-af82-4927-99e9-d6d928d2e608 req-ec58ab2f-5e84-4091-9cc2-9e6db8718bad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035528 Dec 15 11:37:12.111883 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 447/891] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:12 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:12.741378 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-eec074c4-97e8-45a3-bebd-7ca896492901 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:12.742330 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-eec074c4-97e8-45a3-bebd-7ca896492901 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:12.748508 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-eec074c4-97e8-45a3-bebd-7ca896492901 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:12.748955 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-eec074c4-97e8-45a3-bebd-7ca896492901 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:12.749735 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-eec074c4-97e8-45a3-bebd-7ca896492901 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:12.750197 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-eec074c4-97e8-45a3-bebd-7ca896492901 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:12.780362 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-eec074c4-97e8-45a3-bebd-7ca896492901 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043034 Dec 15 11:37:12.780921 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 445/892] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 11:37:12 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 11:37:12.979948 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9c38b5dd-80a3-496b-ab0a-e58973e8e167 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:12.980771 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9c38b5dd-80a3-496b-ab0a-e58973e8e167 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:12.986805 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c38b5dd-80a3-496b-ab0a-e58973e8e167 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:12.987246 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c38b5dd-80a3-496b-ab0a-e58973e8e167 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:12.988014 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c38b5dd-80a3-496b-ab0a-e58973e8e167 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:12.988439 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c38b5dd-80a3-496b-ab0a-e58973e8e167 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:13.001760 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-9c38b5dd-80a3-496b-ab0a-e58973e8e167 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] HTTP exception thrown: Instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd could not be found. Dec 15 11:37:13.002354 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9c38b5dd-80a3-496b-ab0a-e58973e8e167 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Returning 404 to user: Instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:37:13.003207 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9c38b5dd-80a3-496b-ab0a-e58973e8e167 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 404 len: 111 microversion: 2.20 time: 0.027803 Dec 15 11:37:13.003742 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 448/893] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:37:12 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 11:37:13.012422 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-15f24a7b-f573-4c88-bcdb-493dd696c93d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '.version_select at 0x7fdf5977cee0>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:13.025181 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6a9b5ebd-88ff-42f7-ae7d-ff38d206b401 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:13.025808 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6a9b5ebd-88ff-42f7-ae7d-ff38d206b401 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:13.030882 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-15f24a7b-f573-4c88-bcdb-493dd696c93d tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023952740" status: 204 len: 0 microversion: 2.20 time: 0.022507 Dec 15 11:37:13.031684 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 446/894] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Dec 15 11:37:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023952740 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 11:37:13.032854 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a9b5ebd-88ff-42f7-ae7d-ff38d206b401 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:13.033320 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a9b5ebd-88ff-42f7-ae7d-ff38d206b401 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:13.034111 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a9b5ebd-88ff-42f7-ae7d-ff38d206b401 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:13.034548 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a9b5ebd-88ff-42f7-ae7d-ff38d206b401 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:13.182736 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6a9b5ebd-88ff-42f7-ae7d-ff38d206b401 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:13.195662 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6a9b5ebd-88ff-42f7-ae7d-ff38d206b401 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1575 microversion: 2.1 time: 0.174423 Dec 15 11:37:13.200291 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 449/895] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:13 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:37:13.963557 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e4374182-1048-475d-a2f7-dc5dab99aa1e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:13.964052 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e4374182-1048-475d-a2f7-dc5dab99aa1e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:13.969864 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e4374182-1048-475d-a2f7-dc5dab99aa1e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:13.970338 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e4374182-1048-475d-a2f7-dc5dab99aa1e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:13.971167 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e4374182-1048-475d-a2f7-dc5dab99aa1e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:13.971599 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e4374182-1048-475d-a2f7-dc5dab99aa1e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:13.996507 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e4374182-1048-475d-a2f7-dc5dab99aa1e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Going to try to terminate instance {{(pid=116082) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:37:14.075096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e4374182-1048-475d-a2f7-dc5dab99aa1e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 204 len: 0 microversion: 2.1 time: 0.114916 Dec 15 11:37:14.076158 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 447/896] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:37:13 2021] DELETE /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:37:14.083717 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b73b7c82-3fb1-4f14-ae7f-c460af31182a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:14.084327 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b73b7c82-3fb1-4f14-ae7f-c460af31182a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:14.091428 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b73b7c82-3fb1-4f14-ae7f-c460af31182a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:14.091845 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b73b7c82-3fb1-4f14-ae7f-c460af31182a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:14.092607 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b73b7c82-3fb1-4f14-ae7f-c460af31182a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:14.093037 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b73b7c82-3fb1-4f14-ae7f-c460af31182a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:14.220835 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2085f5ee-1218-4467-967f-08ec7916ed8e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:14.221616 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2085f5ee-1218-4467-967f-08ec7916ed8e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:14.227615 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2085f5ee-1218-4467-967f-08ec7916ed8e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:14.228074 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2085f5ee-1218-4467-967f-08ec7916ed8e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:14.228875 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2085f5ee-1218-4467-967f-08ec7916ed8e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:14.229047 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b73b7c82-3fb1-4f14-ae7f-c460af31182a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:14.229324 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2085f5ee-1218-4467-967f-08ec7916ed8e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:14.237700 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b73b7c82-3fb1-4f14-ae7f-c460af31182a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1514 microversion: 2.1 time: 0.157765 Dec 15 11:37:14.238285 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 450/897] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:14 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:14.368124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2085f5ee-1218-4467-967f-08ec7916ed8e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:14.375632 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2085f5ee-1218-4467-967f-08ec7916ed8e tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1575 microversion: 2.1 time: 0.162706 Dec 15 11:37:14.376203 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 448/898] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:14 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:37:14.806713 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-55310f65-2a95-4903-ac0e-43afe2907dfd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:14.807210 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-55310f65-2a95-4903-ac0e-43afe2907dfd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:14.813633 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-55310f65-2a95-4903-ac0e-43afe2907dfd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:14.814074 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-55310f65-2a95-4903-ac0e-43afe2907dfd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:14.814885 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-55310f65-2a95-4903-ac0e-43afe2907dfd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:14.815319 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-55310f65-2a95-4903-ac0e-43afe2907dfd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:14.830091 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-55310f65-2a95-4903-ac0e-43afe2907dfd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] HTTP exception thrown: Instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd could not be found. Dec 15 11:37:14.830706 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-55310f65-2a95-4903-ac0e-43afe2907dfd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Returning 404 to user: Instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:37:14.831521 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-55310f65-2a95-4903-ac0e-43afe2907dfd tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 404 len: 111 microversion: 2.20 time: 0.028579 Dec 15 11:37:14.832046 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 451/899] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 11:37:14 2021] DELETE /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 11:37:14.839928 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ff9920e7-beff-4eb3-82f1-fe355ecd6115 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:14.840532 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-ff9920e7-beff-4eb3-82f1-fe355ecd6115 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:14.846247 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ff9920e7-beff-4eb3-82f1-fe355ecd6115 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:14.846856 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ff9920e7-beff-4eb3-82f1-fe355ecd6115 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:14.847635 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ff9920e7-beff-4eb3-82f1-fe355ecd6115 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:14.848069 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ff9920e7-beff-4eb3-82f1-fe355ecd6115 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:14.860880 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-ff9920e7-beff-4eb3-82f1-fe355ecd6115 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] HTTP exception thrown: Instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd could not be found. Dec 15 11:37:14.861458 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ff9920e7-beff-4eb3-82f1-fe355ecd6115 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Returning 404 to user: Instance 7cc1474a-92ec-418e-9cd4-3f10cf91c8bd could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:37:14.862271 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ff9920e7-beff-4eb3-82f1-fe355ecd6115 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd" status: 404 len: 111 microversion: 2.20 time: 0.025952 Dec 15 11:37:14.862903 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 449/900] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:37:14 2021] GET /compute/v2.1/servers/7cc1474a-92ec-418e-9cd4-3f10cf91c8bd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 11:37:15.256554 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2a908b77-f981-4e37-a40e-11a2f2d7f48a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:15.257492 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2a908b77-f981-4e37-a40e-11a2f2d7f48a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:15.264171 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a908b77-f981-4e37-a40e-11a2f2d7f48a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:15.264612 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a908b77-f981-4e37-a40e-11a2f2d7f48a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:15.265380 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a908b77-f981-4e37-a40e-11a2f2d7f48a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:15.265821 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a908b77-f981-4e37-a40e-11a2f2d7f48a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:15.394283 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2a908b77-f981-4e37-a40e-11a2f2d7f48a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:15.395045 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4743bc94-34dd-472f-b99c-95224e6738d8 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:15.395695 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4743bc94-34dd-472f-b99c-95224e6738d8 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:15.401591 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4743bc94-34dd-472f-b99c-95224e6738d8 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:15.402623 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4743bc94-34dd-472f-b99c-95224e6738d8 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:15.403408 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4743bc94-34dd-472f-b99c-95224e6738d8 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:15.403789 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2a908b77-f981-4e37-a40e-11a2f2d7f48a tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1514 microversion: 2.1 time: 0.151782 Dec 15 11:37:15.403906 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4743bc94-34dd-472f-b99c-95224e6738d8 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:15.404380 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 452/901] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:15 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:15.540547 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4743bc94-34dd-472f-b99c-95224e6738d8 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:15.548380 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4743bc94-34dd-472f-b99c-95224e6738d8 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1575 microversion: 2.1 time: 0.156909 Dec 15 11:37:15.548952 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 450/902] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:15 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:37:15.990329 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d75d9ea4-20f2-48b7-8ec1-e6972286f79a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:15.990936 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d75d9ea4-20f2-48b7-8ec1-e6972286f79a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:15.997421 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d75d9ea4-20f2-48b7-8ec1-e6972286f79a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:15.997956 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d75d9ea4-20f2-48b7-8ec1-e6972286f79a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:15.998981 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d75d9ea4-20f2-48b7-8ec1-e6972286f79a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:15.999481 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d75d9ea4-20f2-48b7-8ec1-e6972286f79a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:16.012597 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-d75d9ea4-20f2-48b7-8ec1-e6972286f79a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] HTTP exception thrown: Instance 0866db17-45ec-4550-b834-8880e974be1d could not be found. Dec 15 11:37:16.013182 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d75d9ea4-20f2-48b7-8ec1-e6972286f79a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Returning 404 to user: Instance 0866db17-45ec-4550-b834-8880e974be1d could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:37:16.014040 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d75d9ea4-20f2-48b7-8ec1-e6972286f79a tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 404 len: 111 microversion: 2.20 time: 0.027479 Dec 15 11:37:16.014600 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 453/903] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 11:37:15 2021] DELETE /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 11:37:16.022439 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d88c3d6d-0ee9-4a4a-bf22-aa5f9f492906 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:16.023139 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-d88c3d6d-0ee9-4a4a-bf22-aa5f9f492906 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] [instance: 0866db17-45ec-4550-b834-8880e974be1d] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:16.029062 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d88c3d6d-0ee9-4a4a-bf22-aa5f9f492906 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:16.029579 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d88c3d6d-0ee9-4a4a-bf22-aa5f9f492906 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:16.030448 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d88c3d6d-0ee9-4a4a-bf22-aa5f9f492906 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:16.030973 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-d88c3d6d-0ee9-4a4a-bf22-aa5f9f492906 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:16.206736 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-d88c3d6d-0ee9-4a4a-bf22-aa5f9f492906 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] HTTP exception thrown: Instance 0866db17-45ec-4550-b834-8880e974be1d could not be found. Dec 15 11:37:16.207382 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-d88c3d6d-0ee9-4a4a-bf22-aa5f9f492906 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] Returning 404 to user: Instance 0866db17-45ec-4550-b834-8880e974be1d could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:37:16.208508 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-d88c3d6d-0ee9-4a4a-bf22-aa5f9f492906 tempest-AttachVolumeShelveTestJSON-1236006977 tempest-AttachVolumeShelveTestJSON-1236006977-project] 10.222.0.18 "GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d" status: 404 len: 111 microversion: 2.20 time: 0.189397 Dec 15 11:37:16.209058 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 451/904] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 11:37:16 2021] GET /compute/v2.1/servers/0866db17-45ec-4550-b834-8880e974be1d => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 11:37:16.350308 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-e7ecda6a-0d8a-4f88-80c0-f193129edc3f req-84d5835f-18db-4aa8-9f75-125f5ca90cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28a109b-548c-434e-8c63-c2dbfdf8b6ad", "name": "network-vif-deleted", "tag": "a5df6016-0907-45c4-831a-7b7e182a15dd"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:16.354003 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:16.354003 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:37:16.368578 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-e7ecda6a-0d8a-4f88-80c0-f193129edc3f req-84d5835f-18db-4aa8-9f75-125f5ca90cce service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:16.369071 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-e7ecda6a-0d8a-4f88-80c0-f193129edc3f req-84d5835f-18db-4aa8-9f75-125f5ca90cce service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:16.382141 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-e7ecda6a-0d8a-4f88-80c0-f193129edc3f req-84d5835f-18db-4aa8-9f75-125f5ca90cce service nova] Creating event network-vif-deleted:a5df6016-0907-45c4-831a-7b7e182a15dd for instance a28a109b-548c-434e-8c63-c2dbfdf8b6ad on hv-cinder-81321 Dec 15 11:37:16.387647 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-e7ecda6a-0d8a-4f88-80c0-f193129edc3f req-84d5835f-18db-4aa8-9f75-125f5ca90cce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040935 Dec 15 11:37:16.388243 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 454/905] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:16.422448 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6bf55244-eda2-4e41-a4f5-26b4cc83708e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:16.424173 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6bf55244-eda2-4e41-a4f5-26b4cc83708e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:16.432944 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6bf55244-eda2-4e41-a4f5-26b4cc83708e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:16.434594 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6bf55244-eda2-4e41-a4f5-26b4cc83708e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:16.435537 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6bf55244-eda2-4e41-a4f5-26b4cc83708e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:16.436223 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6bf55244-eda2-4e41-a4f5-26b4cc83708e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:16.472115 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6bf55244-eda2-4e41-a4f5-26b4cc83708e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:16.473041 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6bf55244-eda2-4e41-a4f5-26b4cc83708e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:16.473647 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-6bf55244-eda2-4e41-a4f5-26b4cc83708e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lazy-loading 'fault' on Instance uuid a28a109b-548c-434e-8c63-c2dbfdf8b6ad {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:37:16.565854 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0b8c1ddd-d199-4550-9ef1-d7773b9834cb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:16.566606 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0b8c1ddd-d199-4550-9ef1-d7773b9834cb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:16.573459 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b8c1ddd-d199-4550-9ef1-d7773b9834cb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:16.573953 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b8c1ddd-d199-4550-9ef1-d7773b9834cb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:16.574936 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b8c1ddd-d199-4550-9ef1-d7773b9834cb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:16.575375 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b8c1ddd-d199-4550-9ef1-d7773b9834cb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:16.719792 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0b8c1ddd-d199-4550-9ef1-d7773b9834cb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:16.733211 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0b8c1ddd-d199-4550-9ef1-d7773b9834cb tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1575 microversion: 2.1 time: 0.171308 Dec 15 11:37:16.733843 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 455/906] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:16 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:37:16.774864 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6bf55244-eda2-4e41-a4f5-26b4cc83708e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:16.784816 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6bf55244-eda2-4e41-a4f5-26b4cc83708e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 200 len: 1307 microversion: 2.1 time: 0.367469 Dec 15 11:37:16.785410 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 452/907] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:16 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 1307 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:17.750982 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-08f0efbd-004b-40a8-ae36-d62401194b2c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:17.751505 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-08f0efbd-004b-40a8-ae36-d62401194b2c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:17.758160 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-08f0efbd-004b-40a8-ae36-d62401194b2c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:17.758632 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-08f0efbd-004b-40a8-ae36-d62401194b2c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:17.759424 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-08f0efbd-004b-40a8-ae36-d62401194b2c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:17.759858 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-08f0efbd-004b-40a8-ae36-d62401194b2c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:17.802557 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-434d9501-992f-4b8d-9f41-98a9d79c3ced tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:17.803130 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-434d9501-992f-4b8d-9f41-98a9d79c3ced tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: a28a109b-548c-434e-8c63-c2dbfdf8b6ad] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:17.811002 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-434d9501-992f-4b8d-9f41-98a9d79c3ced tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:17.811616 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-434d9501-992f-4b8d-9f41-98a9d79c3ced tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:17.812412 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-434d9501-992f-4b8d-9f41-98a9d79c3ced tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:17.812843 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-434d9501-992f-4b8d-9f41-98a9d79c3ced tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:17.832810 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-434d9501-992f-4b8d-9f41-98a9d79c3ced tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] HTTP exception thrown: Instance a28a109b-548c-434e-8c63-c2dbfdf8b6ad could not be found. Dec 15 11:37:17.833706 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-434d9501-992f-4b8d-9f41-98a9d79c3ced tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Returning 404 to user: Instance a28a109b-548c-434e-8c63-c2dbfdf8b6ad could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:37:17.835024 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-434d9501-992f-4b8d-9f41-98a9d79c3ced tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad" status: 404 len: 111 microversion: 2.1 time: 0.036810 Dec 15 11:37:17.838721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 453/908] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:17 2021] GET /compute/v2.1/servers/a28a109b-548c-434e-8c63-c2dbfdf8b6ad => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:37:17.910944 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-08f0efbd-004b-40a8-ae36-d62401194b2c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:17.920692 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-08f0efbd-004b-40a8-ae36-d62401194b2c tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1575 microversion: 2.1 time: 0.173378 Dec 15 11:37:17.934450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 456/909] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:17 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:18.941368 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-bddbf35a-07a1-46d0-8d10-ff31ff626d0a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:18.942138 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-bddbf35a-07a1-46d0-8d10-ff31ff626d0a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:18.952721 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bddbf35a-07a1-46d0-8d10-ff31ff626d0a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:18.953223 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bddbf35a-07a1-46d0-8d10-ff31ff626d0a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:18.954029 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bddbf35a-07a1-46d0-8d10-ff31ff626d0a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:18.954471 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bddbf35a-07a1-46d0-8d10-ff31ff626d0a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:18.984580 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-820d404a-432f-4dfc-95f2-27d20aec0e9e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:18.985982 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-820d404a-432f-4dfc-95f2-27d20aec0e9e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:18.996570 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-820d404a-432f-4dfc-95f2-27d20aec0e9e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:18.997021 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-820d404a-432f-4dfc-95f2-27d20aec0e9e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:19.003288 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-820d404a-432f-4dfc-95f2-27d20aec0e9e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:19.003807 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-820d404a-432f-4dfc-95f2-27d20aec0e9e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:19.034849 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-820d404a-432f-4dfc-95f2-27d20aec0e9e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:37:19.127106 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-820d404a-432f-4dfc-95f2-27d20aec0e9e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "DELETE /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 204 len: 0 microversion: 2.1 time: 0.146190 Dec 15 11:37:19.128373 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 457/910] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:37:18 2021] DELETE /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 11:37:19.138816 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0c67fefa-a3b8-4299-b2c2-636477ac023e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:19.139867 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0c67fefa-a3b8-4299-b2c2-636477ac023e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:19.147356 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c67fefa-a3b8-4299-b2c2-636477ac023e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:19.147800 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c67fefa-a3b8-4299-b2c2-636477ac023e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:19.148832 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c67fefa-a3b8-4299-b2c2-636477ac023e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:19.149112 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c67fefa-a3b8-4299-b2c2-636477ac023e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:19.220390 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-bddbf35a-07a1-46d0-8d10-ff31ff626d0a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:19.227897 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-bddbf35a-07a1-46d0-8d10-ff31ff626d0a tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1575 microversion: 2.1 time: 0.290510 Dec 15 11:37:19.228677 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 454/911] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:18 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1575 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:19.305401 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c67fefa-a3b8-4299-b2c2-636477ac023e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:19.315597 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0c67fefa-a3b8-4299-b2c2-636477ac023e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1514 microversion: 2.1 time: 0.182559 Dec 15 11:37:19.316331 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 458/912] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:19 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:20.248639 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7e80570a-72a0-4bd9-926d-67eee1b2d18d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:20.249303 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7e80570a-72a0-4bd9-926d-67eee1b2d18d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:20.258863 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e80570a-72a0-4bd9-926d-67eee1b2d18d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:20.259318 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e80570a-72a0-4bd9-926d-67eee1b2d18d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:20.265608 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e80570a-72a0-4bd9-926d-67eee1b2d18d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:20.266160 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e80570a-72a0-4bd9-926d-67eee1b2d18d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:20.336331 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e57e54f9-5974-4408-a506-30c75feac86c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:20.336331 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e57e54f9-5974-4408-a506-30c75feac86c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:20.349255 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e57e54f9-5974-4408-a506-30c75feac86c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:20.349800 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e57e54f9-5974-4408-a506-30c75feac86c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:20.350703 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e57e54f9-5974-4408-a506-30c75feac86c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:20.351215 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e57e54f9-5974-4408-a506-30c75feac86c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:20.455804 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7e80570a-72a0-4bd9-926d-67eee1b2d18d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:20.464274 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7e80570a-72a0-4bd9-926d-67eee1b2d18d tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1562 microversion: 2.1 time: 0.222691 Dec 15 11:37:20.464837 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 455/913] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:20 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:20.509372 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e57e54f9-5974-4408-a506-30c75feac86c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:20.519545 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e57e54f9-5974-4408-a506-30c75feac86c tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1514 microversion: 2.1 time: 0.190109 Dec 15 11:37:20.520132 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 459/914] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:20 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:21.345078 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-c942d7cf-6cb9-4990-b592-c30748f1a178 req-6d6e14a7-3863-48ba-8b08-5b050f612540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05624cca-436c-4f44-a73b-c417795f175c", "name": "network-vif-deleted", "tag": "5f6cf12c-7468-47e0-8136-bfbe7a35afdc"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:21.351205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:21.351205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:37:21.364771 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-c942d7cf-6cb9-4990-b592-c30748f1a178 req-6d6e14a7-3863-48ba-8b08-5b050f612540 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:21.365223 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-c942d7cf-6cb9-4990-b592-c30748f1a178 req-6d6e14a7-3863-48ba-8b08-5b050f612540 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:21.378083 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-c942d7cf-6cb9-4990-b592-c30748f1a178 req-6d6e14a7-3863-48ba-8b08-5b050f612540 service nova] Creating event network-vif-deleted:5f6cf12c-7468-47e0-8136-bfbe7a35afdc for instance 05624cca-436c-4f44-a73b-c417795f175c on hv-cinder-81321 Dec 15 11:37:21.383971 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-c942d7cf-6cb9-4990-b592-c30748f1a178 req-6d6e14a7-3863-48ba-8b08-5b050f612540 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042466 Dec 15 11:37:21.389606 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 456/915] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:21.539397 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-90bdeda7-ba20-44ae-acf0-84e8be32b450 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:21.540046 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-90bdeda7-ba20-44ae-acf0-84e8be32b450 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:21.547503 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90bdeda7-ba20-44ae-acf0-84e8be32b450 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:21.547977 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90bdeda7-ba20-44ae-acf0-84e8be32b450 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:21.548828 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90bdeda7-ba20-44ae-acf0-84e8be32b450 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:21.549264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90bdeda7-ba20-44ae-acf0-84e8be32b450 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:21.581055 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90bdeda7-ba20-44ae-acf0-84e8be32b450 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:21.581495 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90bdeda7-ba20-44ae-acf0-84e8be32b450 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:21.581937 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-90bdeda7-ba20-44ae-acf0-84e8be32b450 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lazy-loading 'fault' on Instance uuid 05624cca-436c-4f44-a73b-c417795f175c {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:37:21.622996 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-90bdeda7-ba20-44ae-acf0-84e8be32b450 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:21.630129 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-90bdeda7-ba20-44ae-acf0-84e8be32b450 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 200 len: 1308 microversion: 2.1 time: 0.094519 Dec 15 11:37:21.630845 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 460/916] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:21 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:22.180227 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-280bcf59-e1d4-4b22-8924-32fbe51ba16d req-477c46a9-1b9d-42a6-a8dc-0806bada4837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3f31c4-e258-4bb7-a7c9-795cf3c302af", "name": "network-vif-plugged", "status": "completed", "tag": "fdd01109-ae47-4e03-a1ac-0a3119e113ea"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:22.181815 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:22.181815 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:37:22.189735 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-280bcf59-e1d4-4b22-8924-32fbe51ba16d req-477c46a9-1b9d-42a6-a8dc-0806bada4837 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:22.190184 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-280bcf59-e1d4-4b22-8924-32fbe51ba16d req-477c46a9-1b9d-42a6-a8dc-0806bada4837 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:22.202151 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-280bcf59-e1d4-4b22-8924-32fbe51ba16d req-477c46a9-1b9d-42a6-a8dc-0806bada4837 service nova] Creating event network-vif-plugged:fdd01109-ae47-4e03-a1ac-0a3119e113ea for instance ef3f31c4-e258-4bb7-a7c9-795cf3c302af on hv-cinder-81321 Dec 15 11:37:22.207021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-280bcf59-e1d4-4b22-8924-32fbe51ba16d req-477c46a9-1b9d-42a6-a8dc-0806bada4837 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030836 Dec 15 11:37:22.208637 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 457/917] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:22.647827 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-348e4917-af78-4ce5-8143-9bcc2c930bd3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:22.648446 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-348e4917-af78-4ce5-8143-9bcc2c930bd3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: 05624cca-436c-4f44-a73b-c417795f175c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:22.655460 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-348e4917-af78-4ce5-8143-9bcc2c930bd3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:22.655908 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-348e4917-af78-4ce5-8143-9bcc2c930bd3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:22.656692 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-348e4917-af78-4ce5-8143-9bcc2c930bd3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:22.657129 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-348e4917-af78-4ce5-8143-9bcc2c930bd3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:22.670669 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-348e4917-af78-4ce5-8143-9bcc2c930bd3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] HTTP exception thrown: Instance 05624cca-436c-4f44-a73b-c417795f175c could not be found. Dec 15 11:37:22.671256 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-348e4917-af78-4ce5-8143-9bcc2c930bd3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Returning 404 to user: Instance 05624cca-436c-4f44-a73b-c417795f175c could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:37:22.672063 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-348e4917-af78-4ce5-8143-9bcc2c930bd3 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c" status: 404 len: 111 microversion: 2.1 time: 0.027950 Dec 15 11:37:22.672591 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 461/918] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:22 2021] GET /compute/v2.1/servers/05624cca-436c-4f44-a73b-c417795f175c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:37:22.681327 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fa926912-d642-4ae4-827c-b614687750cd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:22.681911 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fa926912-d642-4ae4-827c-b614687750cd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:22.688274 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fa926912-d642-4ae4-827c-b614687750cd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:22.688733 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fa926912-d642-4ae4-827c-b614687750cd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:22.689510 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fa926912-d642-4ae4-827c-b614687750cd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:22.689944 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fa926912-d642-4ae4-827c-b614687750cd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:22.715127 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fa926912-d642-4ae4-827c-b614687750cd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Going to try to terminate instance {{(pid=116082) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:37:22.789682 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fa926912-d642-4ae4-827c-b614687750cd tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 204 len: 0 microversion: 2.1 time: 0.112471 Dec 15 11:37:22.790375 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 458/919] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:37:22 2021] DELETE /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:37:22.800486 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fa5322f7-7a07-47ff-a8ab-2eb3197bd0fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:22.801106 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fa5322f7-7a07-47ff-a8ab-2eb3197bd0fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:22.807977 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa5322f7-7a07-47ff-a8ab-2eb3197bd0fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:22.808917 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa5322f7-7a07-47ff-a8ab-2eb3197bd0fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:22.810193 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa5322f7-7a07-47ff-a8ab-2eb3197bd0fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:22.810958 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa5322f7-7a07-47ff-a8ab-2eb3197bd0fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:22.944964 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fa5322f7-7a07-47ff-a8ab-2eb3197bd0fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:22.953043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fa5322f7-7a07-47ff-a8ab-2eb3197bd0fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1513 microversion: 2.1 time: 0.156493 Dec 15 11:37:22.953744 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 462/920] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:22 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:23.970920 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4849ec35-a65e-4f1e-b5bd-642b8935cbe9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:23.971676 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4849ec35-a65e-4f1e-b5bd-642b8935cbe9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:23.977808 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4849ec35-a65e-4f1e-b5bd-642b8935cbe9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:23.978258 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4849ec35-a65e-4f1e-b5bd-642b8935cbe9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:23.979071 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4849ec35-a65e-4f1e-b5bd-642b8935cbe9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:23.980094 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4849ec35-a65e-4f1e-b5bd-642b8935cbe9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:24.112013 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4849ec35-a65e-4f1e-b5bd-642b8935cbe9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:24.119414 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4849ec35-a65e-4f1e-b5bd-642b8935cbe9 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 200 len: 1513 microversion: 2.1 time: 0.152560 Dec 15 11:37:24.120247 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 459/921] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:23 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:24.561448 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-49958563-811e-479e-97bf-7529c83e2c9b req-8ab25c67-9be8-43a6-9df1-9599e0b530e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd3853d-a075-4cd2-a933-63ad7e8e7d25", "name": "network-vif-deleted", "tag": "1baa613c-7810-4c50-8aa5-1b8f154667f4"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:24.563525 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:24.563525 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:37:24.572623 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-49958563-811e-479e-97bf-7529c83e2c9b req-8ab25c67-9be8-43a6-9df1-9599e0b530e8 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:24.573085 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-49958563-811e-479e-97bf-7529c83e2c9b req-8ab25c67-9be8-43a6-9df1-9599e0b530e8 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:24.587540 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-49958563-811e-479e-97bf-7529c83e2c9b req-8ab25c67-9be8-43a6-9df1-9599e0b530e8 service nova] Creating event network-vif-deleted:1baa613c-7810-4c50-8aa5-1b8f154667f4 for instance bdd3853d-a075-4cd2-a933-63ad7e8e7d25 on hv-cinder-81321 Dec 15 11:37:24.593198 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-49958563-811e-479e-97bf-7529c83e2c9b req-8ab25c67-9be8-43a6-9df1-9599e0b530e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035657 Dec 15 11:37:24.593805 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 463/922] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:25.136256 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5cc14cf9-d7d4-4720-a324-7bd31d7a6c8e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:25.136876 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5cc14cf9-d7d4-4720-a324-7bd31d7a6c8e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: bdd3853d-a075-4cd2-a933-63ad7e8e7d25] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:25.143555 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5cc14cf9-d7d4-4720-a324-7bd31d7a6c8e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:25.144013 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5cc14cf9-d7d4-4720-a324-7bd31d7a6c8e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:25.144798 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5cc14cf9-d7d4-4720-a324-7bd31d7a6c8e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:25.145235 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5cc14cf9-d7d4-4720-a324-7bd31d7a6c8e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:25.158389 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-5cc14cf9-d7d4-4720-a324-7bd31d7a6c8e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] HTTP exception thrown: Instance bdd3853d-a075-4cd2-a933-63ad7e8e7d25 could not be found. Dec 15 11:37:25.159010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5cc14cf9-d7d4-4720-a324-7bd31d7a6c8e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Returning 404 to user: Instance bdd3853d-a075-4cd2-a933-63ad7e8e7d25 could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:37:25.159832 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5cc14cf9-d7d4-4720-a324-7bd31d7a6c8e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25" status: 404 len: 111 microversion: 2.1 time: 0.027410 Dec 15 11:37:25.160363 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 460/923] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:25 2021] GET /compute/v2.1/servers/bdd3853d-a075-4cd2-a933-63ad7e8e7d25 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:37:26.291407 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ac8d4cf7-1372-4866-8c78-a93967c227fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:26.291989 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ac8d4cf7-1372-4866-8c78-a93967c227fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:26.299329 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac8d4cf7-1372-4866-8c78-a93967c227fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:26.299950 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac8d4cf7-1372-4866-8c78-a93967c227fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:26.300626 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac8d4cf7-1372-4866-8c78-a93967c227fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:26.301067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac8d4cf7-1372-4866-8c78-a93967c227fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:26.328992 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ac8d4cf7-1372-4866-8c78-a93967c227fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:37:26.407773 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ac8d4cf7-1372-4866-8c78-a93967c227fb tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 204 len: 0 microversion: 2.1 time: 0.122142 Dec 15 11:37:26.408456 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 464/924] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:37:26 2021] DELETE /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:37:26.416602 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7cb815c9-60b7-4fbf-a65f-526540e9d16e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:26.418010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7cb815c9-60b7-4fbf-a65f-526540e9d16e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:26.425135 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cb815c9-60b7-4fbf-a65f-526540e9d16e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:26.425656 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cb815c9-60b7-4fbf-a65f-526540e9d16e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:26.426592 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cb815c9-60b7-4fbf-a65f-526540e9d16e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:26.427064 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7cb815c9-60b7-4fbf-a65f-526540e9d16e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:26.581571 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7cb815c9-60b7-4fbf-a65f-526540e9d16e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:26.590216 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7cb815c9-60b7-4fbf-a65f-526540e9d16e tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1515 microversion: 2.1 time: 0.177178 Dec 15 11:37:26.590821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 461/925] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:26 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:27.609352 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6ef1398c-3454-45a5-bb54-797b88d2f4fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:27.610055 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6ef1398c-3454-45a5-bb54-797b88d2f4fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:27.616785 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ef1398c-3454-45a5-bb54-797b88d2f4fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:27.617238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ef1398c-3454-45a5-bb54-797b88d2f4fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:27.618017 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ef1398c-3454-45a5-bb54-797b88d2f4fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:27.618675 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ef1398c-3454-45a5-bb54-797b88d2f4fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:27.980262 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6ef1398c-3454-45a5-bb54-797b88d2f4fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a345ca59614a4cfcae8233cf97b72e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6e901a7324a01958df150d8e8562d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:27.988227 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6ef1398c-3454-45a5-bb54-797b88d2f4fc tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 200 len: 1515 microversion: 2.1 time: 0.383806 Dec 15 11:37:27.997876 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 465/926] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:27 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:28.467751 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-5f4b1b87-dd72-492b-aa70-9f0ec2c1c780 req-2f5a75ef-7bff-4009-977f-fcf069344511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6106fc8-c8d7-4470-8d4e-a238d8bba8e3", "name": "network-vif-deleted", "tag": "8b1eef73-9848-4fec-b633-d73eada19195"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:28.470029 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:28.470029 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:37:28.479265 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-5f4b1b87-dd72-492b-aa70-9f0ec2c1c780 req-2f5a75ef-7bff-4009-977f-fcf069344511 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:28.479973 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-5f4b1b87-dd72-492b-aa70-9f0ec2c1c780 req-2f5a75ef-7bff-4009-977f-fcf069344511 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:28.492862 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-5f4b1b87-dd72-492b-aa70-9f0ec2c1c780 req-2f5a75ef-7bff-4009-977f-fcf069344511 service nova] Creating event network-vif-deleted:8b1eef73-9848-4fec-b633-d73eada19195 for instance f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 on hv-cinder-81321 Dec 15 11:37:28.498963 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-5f4b1b87-dd72-492b-aa70-9f0ec2c1c780 req-2f5a75ef-7bff-4009-977f-fcf069344511 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035184 Dec 15 11:37:28.499549 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 462/927] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:29.007300 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-12b75e62-1757-4cd2-94cf-3e8fc2138d77 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:29.008013 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-12b75e62-1757-4cd2-94cf-3e8fc2138d77 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] [instance: f6106fc8-c8d7-4470-8d4e-a238d8bba8e3] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:29.014213 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12b75e62-1757-4cd2-94cf-3e8fc2138d77 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:29.014690 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12b75e62-1757-4cd2-94cf-3e8fc2138d77 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:29.015465 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12b75e62-1757-4cd2-94cf-3e8fc2138d77 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:29.015894 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12b75e62-1757-4cd2-94cf-3e8fc2138d77 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:29.032699 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-12b75e62-1757-4cd2-94cf-3e8fc2138d77 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] HTTP exception thrown: Instance f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 could not be found. Dec 15 11:37:29.033294 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-12b75e62-1757-4cd2-94cf-3e8fc2138d77 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] Returning 404 to user: Instance f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:37:29.034123 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-12b75e62-1757-4cd2-94cf-3e8fc2138d77 tempest-AttachVolumeNegativeTest-1103930694 tempest-AttachVolumeNegativeTest-1103930694-project] 10.222.0.18 "GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3" status: 404 len: 111 microversion: 2.1 time: 0.030556 Dec 15 11:37:29.034684 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 466/928] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:29 2021] GET /compute/v2.1/servers/f6106fc8-c8d7-4470-8d4e-a238d8bba8e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 11:37:34.678158 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-204296975", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "networks": [{"uuid": "34feb7ed-7359-4312-8af3-6a5b721a8cfb"}]}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:34.730229 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.network.neutron [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] validate_networks() for [('34feb7ed-7359-4312-8af3-6a5b721a8cfb', None, None, None, None, None)] {{(pid=116082) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:37:35.090455 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Flavor limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:37:35.090930 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Image limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:37:35.091366 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Flavor pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:37:35.091770 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Image pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:37:35.092181 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:37:35.101116 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:35.101567 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:35.102422 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:35.105093 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:35.122504 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Getting quotas for project ebaa42d45f684fb7bb5458dc4538ced7. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:37:35.126504 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Getting quotas for user 79eef4ab1c3447cfba6f8d02aa20fef9 and project ebaa42d45f684fb7bb5458dc4538ced7. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:37:35.138285 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Going to run 1 instances... {{(pid=116082) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:37:35.140756 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116082) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:37:35.189153 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-986052eb-ddfc-4775-8196-9ea0b8fe1de1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511573 Dec 15 11:37:35.189153 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 463/929] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:37:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:37:35.200062 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ed1694c7-3f0d-44f2-9589-a8055e546848 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:35.200783 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ed1694c7-3f0d-44f2-9589-a8055e546848 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:35.259081 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ed1694c7-3f0d-44f2-9589-a8055e546848 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:35.267051 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ed1694c7-3f0d-44f2-9589-a8055e546848 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1213 microversion: 2.1 time: 0.071226 Dec 15 11:37:35.267572 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 467/930] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:35 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:36.284057 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5a3d3a10-073f-4d37-a3d0-e68e32f32287 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:36.284678 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5a3d3a10-073f-4d37-a3d0-e68e32f32287 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:36.292398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5a3d3a10-073f-4d37-a3d0-e68e32f32287 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:36.292852 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5a3d3a10-073f-4d37-a3d0-e68e32f32287 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:36.293656 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5a3d3a10-073f-4d37-a3d0-e68e32f32287 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:36.294099 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5a3d3a10-073f-4d37-a3d0-e68e32f32287 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:36.357137 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-5a3d3a10-073f-4d37-a3d0-e68e32f32287 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:36.365118 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5a3d3a10-073f-4d37-a3d0-e68e32f32287 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1271 microversion: 2.1 time: 0.084812 Dec 15 11:37:36.365712 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 464/931] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:36 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:37.382450 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2eaa0a7b-21ff-4e8e-b39c-c77b4920f371 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:37.383221 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2eaa0a7b-21ff-4e8e-b39c-c77b4920f371 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:37.395234 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-7f91e2f5-9f5c-4e62-80ce-9704f98ab508 req-695af979-f42c-4d4a-ad46-050d030a4982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08fb901b-0272-4602-83f3-5c40dd4f8709", "tag": "308ee498-ef95-4afa-ad9a-9046fb58a9d0"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:37.396938 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:37.396938 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:37:37.402045 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2eaa0a7b-21ff-4e8e-b39c-c77b4920f371 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:37.402617 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2eaa0a7b-21ff-4e8e-b39c-c77b4920f371 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:37.403484 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2eaa0a7b-21ff-4e8e-b39c-c77b4920f371 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:37.404127 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2eaa0a7b-21ff-4e8e-b39c-c77b4920f371 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:37.407579 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-7f91e2f5-9f5c-4e62-80ce-9704f98ab508 req-695af979-f42c-4d4a-ad46-050d030a4982 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:37.408033 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-7f91e2f5-9f5c-4e62-80ce-9704f98ab508 req-695af979-f42c-4d4a-ad46-050d030a4982 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:37.427446 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-7f91e2f5-9f5c-4e62-80ce-9704f98ab508 req-695af979-f42c-4d4a-ad46-050d030a4982 service nova] Creating event network-changed:308ee498-ef95-4afa-ad9a-9046fb58a9d0 for instance 08fb901b-0272-4602-83f3-5c40dd4f8709 on hv-cinder-81321 Dec 15 11:37:37.434210 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-7f91e2f5-9f5c-4e62-80ce-9704f98ab508 req-695af979-f42c-4d4a-ad46-050d030a4982 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042401 Dec 15 11:37:37.435045 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 465/932] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:37.619748 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2eaa0a7b-21ff-4e8e-b39c-c77b4920f371 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:37.627014 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2eaa0a7b-21ff-4e8e-b39c-c77b4920f371 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1313 microversion: 2.1 time: 0.248447 Dec 15 11:37:37.627581 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 468/933] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:37 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:37:38.644618 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7f31df99-742a-4c35-a392-d66a8fa74d8b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:38.645336 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7f31df99-742a-4c35-a392-d66a8fa74d8b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:38.651626 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7f31df99-742a-4c35-a392-d66a8fa74d8b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:38.652080 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7f31df99-742a-4c35-a392-d66a8fa74d8b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:38.652858 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7f31df99-742a-4c35-a392-d66a8fa74d8b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:38.653296 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7f31df99-742a-4c35-a392-d66a8fa74d8b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:38.787191 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7f31df99-742a-4c35-a392-d66a8fa74d8b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:38.794911 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7f31df99-742a-4c35-a392-d66a8fa74d8b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1313 microversion: 2.1 time: 0.154746 Dec 15 11:37:38.795468 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 466/934] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:38 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:39.810921 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a5a63212-4329-49e9-9b57-66fd3607098a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:39.811503 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a5a63212-4329-49e9-9b57-66fd3607098a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:39.817957 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a5a63212-4329-49e9-9b57-66fd3607098a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:39.818483 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a5a63212-4329-49e9-9b57-66fd3607098a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:39.819451 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a5a63212-4329-49e9-9b57-66fd3607098a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:39.819950 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a5a63212-4329-49e9-9b57-66fd3607098a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:39.956859 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a5a63212-4329-49e9-9b57-66fd3607098a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:39.964847 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a5a63212-4329-49e9-9b57-66fd3607098a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1313 microversion: 2.1 time: 0.158181 Dec 15 11:37:39.965417 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 469/935] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:39 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:40.980934 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-6c889ab5-93d1-4ee2-9264-222360d47ae7 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:40.981587 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-6c889ab5-93d1-4ee2-9264-222360d47ae7 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:40.987902 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6c889ab5-93d1-4ee2-9264-222360d47ae7 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:40.988376 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6c889ab5-93d1-4ee2-9264-222360d47ae7 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:40.989152 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6c889ab5-93d1-4ee2-9264-222360d47ae7 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:40.989581 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-6c889ab5-93d1-4ee2-9264-222360d47ae7 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:41.124830 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-6c889ab5-93d1-4ee2-9264-222360d47ae7 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:41.132081 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-6c889ab5-93d1-4ee2-9264-222360d47ae7 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1313 microversion: 2.1 time: 0.154996 Dec 15 11:37:41.132647 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 467/936] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:40 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:42.153707 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2444959c-2b9f-4d4f-b6d7-f6906eb81cab tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:42.156257 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2444959c-2b9f-4d4f-b6d7-f6906eb81cab tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:42.163175 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2444959c-2b9f-4d4f-b6d7-f6906eb81cab tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:42.163629 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2444959c-2b9f-4d4f-b6d7-f6906eb81cab tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:42.164479 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2444959c-2b9f-4d4f-b6d7-f6906eb81cab tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:42.164948 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2444959c-2b9f-4d4f-b6d7-f6906eb81cab tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:42.311293 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-e264866f-f34e-4091-b667-2f5d086c5ede req-ba3cff90-6148-4f34-b8e2-cf13c141e8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08fb901b-0272-4602-83f3-5c40dd4f8709", "name": "network-vif-plugged", "status": "completed", "tag": "308ee498-ef95-4afa-ad9a-9046fb58a9d0"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:42.312949 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:42.312949 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:37:42.320308 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-e264866f-f34e-4091-b667-2f5d086c5ede req-ba3cff90-6148-4f34-b8e2-cf13c141e8e5 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:42.320918 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-e264866f-f34e-4091-b667-2f5d086c5ede req-ba3cff90-6148-4f34-b8e2-cf13c141e8e5 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:42.334018 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-e264866f-f34e-4091-b667-2f5d086c5ede req-ba3cff90-6148-4f34-b8e2-cf13c141e8e5 service nova] Creating event network-vif-plugged:308ee498-ef95-4afa-ad9a-9046fb58a9d0 for instance 08fb901b-0272-4602-83f3-5c40dd4f8709 on hv-cinder-81321 Dec 15 11:37:42.340137 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-e264866f-f34e-4091-b667-2f5d086c5ede req-ba3cff90-6148-4f34-b8e2-cf13c141e8e5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033546 Dec 15 11:37:42.341203 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 468/937] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:37:42.386035 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2444959c-2b9f-4d4f-b6d7-f6906eb81cab tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:42.394244 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2444959c-2b9f-4d4f-b6d7-f6906eb81cab tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1313 microversion: 2.1 time: 0.248774 Dec 15 11:37:42.394954 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 470/938] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:42 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:43.412177 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f6437fc5-379d-41c9-a1e5-2cf3aac2b5e8 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:43.412871 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f6437fc5-379d-41c9-a1e5-2cf3aac2b5e8 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:43.419010 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f6437fc5-379d-41c9-a1e5-2cf3aac2b5e8 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:43.419457 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f6437fc5-379d-41c9-a1e5-2cf3aac2b5e8 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:43.420235 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f6437fc5-379d-41c9-a1e5-2cf3aac2b5e8 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:43.420667 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f6437fc5-379d-41c9-a1e5-2cf3aac2b5e8 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:43.562603 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f6437fc5-379d-41c9-a1e5-2cf3aac2b5e8 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:43.570654 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f6437fc5-379d-41c9-a1e5-2cf3aac2b5e8 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1313 microversion: 2.1 time: 0.162776 Dec 15 11:37:43.571433 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 469/939] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:43 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:44.587683 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f8b9f8fa-9059-4574-bba0-e91c1e1c3cb4 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:44.588979 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f8b9f8fa-9059-4574-bba0-e91c1e1c3cb4 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:44.595404 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8b9f8fa-9059-4574-bba0-e91c1e1c3cb4 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:44.595865 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8b9f8fa-9059-4574-bba0-e91c1e1c3cb4 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:44.596606 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8b9f8fa-9059-4574-bba0-e91c1e1c3cb4 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:44.597032 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8b9f8fa-9059-4574-bba0-e91c1e1c3cb4 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:44.746393 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f8b9f8fa-9059-4574-bba0-e91c1e1c3cb4 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:44.753720 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f8b9f8fa-9059-4574-bba0-e91c1e1c3cb4 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1496 microversion: 2.1 time: 0.169703 Dec 15 11:37:44.754282 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 471/940] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:44 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1496 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:45.159580 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-87d84323-2540-45eb-ae16-4e57ac33f49a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:45.160114 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-87d84323-2540-45eb-ae16-4e57ac33f49a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:45.166929 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-87d84323-2540-45eb-ae16-4e57ac33f49a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:45.167379 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-87d84323-2540-45eb-ae16-4e57ac33f49a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:45.168167 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-87d84323-2540-45eb-ae16-4e57ac33f49a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:45.168609 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-87d84323-2540-45eb-ae16-4e57ac33f49a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:45.193997 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-87d84323-2540-45eb-ae16-4e57ac33f49a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Going to try to terminate instance {{(pid=116082) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:37:45.268766 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-87d84323-2540-45eb-ae16-4e57ac33f49a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "DELETE /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 204 len: 0 microversion: 2.1 time: 0.112472 Dec 15 11:37:45.269276 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 470/941] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:37:45 2021] DELETE /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:37:45.278275 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e78a7990-be9b-4cf4-a0c7-c5aea5cd0917 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:45.278937 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e78a7990-be9b-4cf4-a0c7-c5aea5cd0917 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:45.284815 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e78a7990-be9b-4cf4-a0c7-c5aea5cd0917 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:45.285265 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e78a7990-be9b-4cf4-a0c7-c5aea5cd0917 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:45.286044 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e78a7990-be9b-4cf4-a0c7-c5aea5cd0917 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:45.286481 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e78a7990-be9b-4cf4-a0c7-c5aea5cd0917 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:45.413835 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e78a7990-be9b-4cf4-a0c7-c5aea5cd0917 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:45.421169 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e78a7990-be9b-4cf4-a0c7-c5aea5cd0917 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1502 microversion: 2.1 time: 0.147565 Dec 15 11:37:45.421736 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 472/942] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:45 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:46.439734 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e6967ee8-83f8-4059-807e-c295498ba7fa tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:46.440423 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e6967ee8-83f8-4059-807e-c295498ba7fa tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:46.446658 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6967ee8-83f8-4059-807e-c295498ba7fa tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:46.447164 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6967ee8-83f8-4059-807e-c295498ba7fa tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:46.447940 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6967ee8-83f8-4059-807e-c295498ba7fa tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:46.448372 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e6967ee8-83f8-4059-807e-c295498ba7fa tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:46.577220 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-e6967ee8-83f8-4059-807e-c295498ba7fa tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:46.584690 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e6967ee8-83f8-4059-807e-c295498ba7fa tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1502 microversion: 2.1 time: 0.149357 Dec 15 11:37:46.585432 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 471/943] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:46 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:47.189145 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-ac8e7880-9ecf-43c3-ad37-3f2a2f7d7d6a req-683c6d91-9f0b-44f1-88fe-d34c8b1a0c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08fb901b-0272-4602-83f3-5c40dd4f8709", "name": "network-vif-deleted", "tag": "308ee498-ef95-4afa-ad9a-9046fb58a9d0"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:47.195682 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:47.195682 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:37:47.215944 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-ac8e7880-9ecf-43c3-ad37-3f2a2f7d7d6a req-683c6d91-9f0b-44f1-88fe-d34c8b1a0c35 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:47.216618 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-ac8e7880-9ecf-43c3-ad37-3f2a2f7d7d6a req-683c6d91-9f0b-44f1-88fe-d34c8b1a0c35 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:47.228632 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-ac8e7880-9ecf-43c3-ad37-3f2a2f7d7d6a req-683c6d91-9f0b-44f1-88fe-d34c8b1a0c35 service nova] Creating event network-vif-deleted:308ee498-ef95-4afa-ad9a-9046fb58a9d0 for instance 08fb901b-0272-4602-83f3-5c40dd4f8709 on hv-cinder-81321 Dec 15 11:37:47.233830 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-ac8e7880-9ecf-43c3-ad37-3f2a2f7d7d6a req-683c6d91-9f0b-44f1-88fe-d34c8b1a0c35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048245 Dec 15 11:37:47.234498 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 473/944] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:47.601063 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fb90d93e-1a29-4ffd-99fc-3694f08dec70 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:47.601722 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fb90d93e-1a29-4ffd-99fc-3694f08dec70 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:47.609502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fb90d93e-1a29-4ffd-99fc-3694f08dec70 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:47.609909 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fb90d93e-1a29-4ffd-99fc-3694f08dec70 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:47.611234 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fb90d93e-1a29-4ffd-99fc-3694f08dec70 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:47.611234 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fb90d93e-1a29-4ffd-99fc-3694f08dec70 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:47.647206 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fb90d93e-1a29-4ffd-99fc-3694f08dec70 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:47.647746 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fb90d93e-1a29-4ffd-99fc-3694f08dec70 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:47.648459 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-fb90d93e-1a29-4ffd-99fc-3694f08dec70 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lazy-loading 'fault' on Instance uuid 08fb901b-0272-4602-83f3-5c40dd4f8709 {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:37:47.947388 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fb90d93e-1a29-4ffd-99fc-3694f08dec70 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:47.954587 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fb90d93e-1a29-4ffd-99fc-3694f08dec70 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 200 len: 1303 microversion: 2.1 time: 0.357267 Dec 15 11:37:47.955242 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 472/945] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:47 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 1303 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:48.973741 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2c138a89-3dc5-4085-80e8-8417c896c38e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:48.974586 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2c138a89-3dc5-4085-80e8-8417c896c38e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 08fb901b-0272-4602-83f3-5c40dd4f8709] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:48.980592 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c138a89-3dc5-4085-80e8-8417c896c38e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:48.981040 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c138a89-3dc5-4085-80e8-8417c896c38e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:48.981819 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c138a89-3dc5-4085-80e8-8417c896c38e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:48.982255 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c138a89-3dc5-4085-80e8-8417c896c38e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:48.995250 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-2c138a89-3dc5-4085-80e8-8417c896c38e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] HTTP exception thrown: Instance 08fb901b-0272-4602-83f3-5c40dd4f8709 could not be found. Dec 15 11:37:48.995839 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2c138a89-3dc5-4085-80e8-8417c896c38e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Returning 404 to user: Instance 08fb901b-0272-4602-83f3-5c40dd4f8709 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:37:48.996657 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2c138a89-3dc5-4085-80e8-8417c896c38e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709" status: 404 len: 111 microversion: 2.1 time: 0.027432 Dec 15 11:37:48.997415 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 474/946] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:48 2021] GET /compute/v2.1/servers/08fb901b-0272-4602-83f3-5c40dd4f8709 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:37:49.107685 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1540114838", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "networks": [{"uuid": "34feb7ed-7359-4312-8af3-6a5b721a8cfb"}]}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:49.168402 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.network.neutron [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] validate_networks() for [('34feb7ed-7359-4312-8af3-6a5b721a8cfb', None, None, None, None, None)] {{(pid=116082) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:37:49.523173 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Flavor limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:37:49.523598 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Image limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:37:49.524072 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Flavor pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:37:49.524511 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Image pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:37:49.524923 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:37:49.533415 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:49.533860 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:49.534710 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:49.535146 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:49.550948 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Getting quotas for project ebaa42d45f684fb7bb5458dc4538ced7. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:37:49.554805 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Getting quotas for user 79eef4ab1c3447cfba6f8d02aa20fef9 and project ebaa42d45f684fb7bb5458dc4538ced7. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:37:49.565845 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Going to run 1 instances... {{(pid=116082) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:37:49.568205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116082) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:37:49.613661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-bb2cd96a-5368-4d59-ad54-5ee743536dc1 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509655 Dec 15 11:37:49.614309 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 473/947] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:37:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 11:37:49.624916 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-224e2ddb-3452-41b7-8fd5-be52a6160808 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:49.625608 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-224e2ddb-3452-41b7-8fd5-be52a6160808 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:49.678012 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-224e2ddb-3452-41b7-8fd5-be52a6160808 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:49.685241 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-224e2ddb-3452-41b7-8fd5-be52a6160808 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 200 len: 1214 microversion: 2.1 time: 0.063978 Dec 15 11:37:49.685805 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 475/948] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:49 2021] GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:50.702091 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f2e41c9e-2941-4dd4-a6b6-32218fbfc24c tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:50.702732 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f2e41c9e-2941-4dd4-a6b6-32218fbfc24c tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:50.708760 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2e41c9e-2941-4dd4-a6b6-32218fbfc24c tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:50.709213 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2e41c9e-2941-4dd4-a6b6-32218fbfc24c tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:50.709992 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2e41c9e-2941-4dd4-a6b6-32218fbfc24c tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:50.710420 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f2e41c9e-2941-4dd4-a6b6-32218fbfc24c tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:50.776486 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f2e41c9e-2941-4dd4-a6b6-32218fbfc24c tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:50.784072 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f2e41c9e-2941-4dd4-a6b6-32218fbfc24c tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 200 len: 1272 microversion: 2.1 time: 0.085940 Dec 15 11:37:50.784995 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 474/949] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:50 2021] GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:51.779346 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-1ea56adc-115b-4d4d-95b0-bbfa4f54f9ec req-9765edf3-daa2-46c9-993d-d6c9daab98f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "656fa510-4569-4c84-9d4a-40b11d2a02cc", "tag": "06628c1c-7df5-48fe-a8e7-d3b1b93347ee"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:51.781638 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:51.781638 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:37:51.789982 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1ea56adc-115b-4d4d-95b0-bbfa4f54f9ec req-9765edf3-daa2-46c9-993d-d6c9daab98f5 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:51.792205 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1ea56adc-115b-4d4d-95b0-bbfa4f54f9ec req-9765edf3-daa2-46c9-993d-d6c9daab98f5 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:51.802291 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fb75eea6-1e58-4b03-9a51-88d90c67cf98 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:51.803024 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fb75eea6-1e58-4b03-9a51-88d90c67cf98 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:51.810383 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fb75eea6-1e58-4b03-9a51-88d90c67cf98 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:51.811251 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fb75eea6-1e58-4b03-9a51-88d90c67cf98 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:51.812243 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fb75eea6-1e58-4b03-9a51-88d90c67cf98 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:51.812703 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fb75eea6-1e58-4b03-9a51-88d90c67cf98 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:51.814261 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-1ea56adc-115b-4d4d-95b0-bbfa4f54f9ec req-9765edf3-daa2-46c9-993d-d6c9daab98f5 service nova] Creating event network-changed:06628c1c-7df5-48fe-a8e7-d3b1b93347ee for instance 656fa510-4569-4c84-9d4a-40b11d2a02cc on hv-cinder-81321 Dec 15 11:37:51.819476 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-1ea56adc-115b-4d4d-95b0-bbfa4f54f9ec req-9765edf3-daa2-46c9-993d-d6c9daab98f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044645 Dec 15 11:37:51.820432 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 476/950] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:51.975061 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fb75eea6-1e58-4b03-9a51-88d90c67cf98 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:51.982445 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fb75eea6-1e58-4b03-9a51-88d90c67cf98 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 200 len: 1314 microversion: 2.1 time: 0.184980 Dec 15 11:37:51.983057 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 475/951] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:51 2021] GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:52.999292 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d16b09ed-bc08-482b-97d8-8483f799fd54 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:53.000012 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d16b09ed-bc08-482b-97d8-8483f799fd54 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:53.006156 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d16b09ed-bc08-482b-97d8-8483f799fd54 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:53.006654 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d16b09ed-bc08-482b-97d8-8483f799fd54 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:53.007503 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d16b09ed-bc08-482b-97d8-8483f799fd54 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:53.007947 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d16b09ed-bc08-482b-97d8-8483f799fd54 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:53.146038 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d16b09ed-bc08-482b-97d8-8483f799fd54 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:53.153713 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d16b09ed-bc08-482b-97d8-8483f799fd54 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 200 len: 1314 microversion: 2.1 time: 0.158990 Dec 15 11:37:53.154282 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 477/952] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:52 2021] GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:54.171200 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3dc2c996-8802-4302-ae75-f3e8a0c535b9 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:54.171824 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3dc2c996-8802-4302-ae75-f3e8a0c535b9 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:54.182372 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3dc2c996-8802-4302-ae75-f3e8a0c535b9 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:54.182860 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3dc2c996-8802-4302-ae75-f3e8a0c535b9 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:54.183660 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3dc2c996-8802-4302-ae75-f3e8a0c535b9 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:54.184099 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3dc2c996-8802-4302-ae75-f3e8a0c535b9 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:54.329687 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-3dc2c996-8802-4302-ae75-f3e8a0c535b9 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:54.338325 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3dc2c996-8802-4302-ae75-f3e8a0c535b9 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 200 len: 1314 microversion: 2.1 time: 0.171009 Dec 15 11:37:54.342596 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 476/953] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:54 2021] GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:55.355609 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4247a316-8048-4410-92cf-6b652dd0fc94 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:55.356215 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4247a316-8048-4410-92cf-6b652dd0fc94 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:55.362846 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4247a316-8048-4410-92cf-6b652dd0fc94 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:55.363346 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4247a316-8048-4410-92cf-6b652dd0fc94 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:55.364125 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4247a316-8048-4410-92cf-6b652dd0fc94 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:55.364552 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4247a316-8048-4410-92cf-6b652dd0fc94 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:55.500841 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4247a316-8048-4410-92cf-6b652dd0fc94 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:55.508533 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4247a316-8048-4410-92cf-6b652dd0fc94 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 200 len: 1314 microversion: 2.1 time: 0.157226 Dec 15 11:37:55.509358 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 478/954] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:55 2021] GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:37:56.361827 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-e28eda22-ce1e-48ec-8017-cebffd0bab23 req-4af12294-cfec-4cc3-a3b9-5210a36a2277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656fa510-4569-4c84-9d4a-40b11d2a02cc", "name": "network-vif-plugged", "status": "completed", "tag": "06628c1c-7df5-48fe-a8e7-d3b1b93347ee"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:37:56.363502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:37:56.363502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:37:56.372404 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-e28eda22-ce1e-48ec-8017-cebffd0bab23 req-4af12294-cfec-4cc3-a3b9-5210a36a2277 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:56.372995 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-e28eda22-ce1e-48ec-8017-cebffd0bab23 req-4af12294-cfec-4cc3-a3b9-5210a36a2277 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:56.386086 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-e28eda22-ce1e-48ec-8017-cebffd0bab23 req-4af12294-cfec-4cc3-a3b9-5210a36a2277 service nova] Creating event network-vif-plugged:06628c1c-7df5-48fe-a8e7-d3b1b93347ee for instance 656fa510-4569-4c84-9d4a-40b11d2a02cc on hv-cinder-81321 Dec 15 11:37:56.391282 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-e28eda22-ce1e-48ec-8017-cebffd0bab23 req-4af12294-cfec-4cc3-a3b9-5210a36a2277 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033228 Dec 15 11:37:56.392016 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 477/955] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:37:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:37:56.526098 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e6d9b655-f94a-4fe1-9697-a706a12a2852 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:56.526745 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e6d9b655-f94a-4fe1-9697-a706a12a2852 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:56.533122 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6d9b655-f94a-4fe1-9697-a706a12a2852 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:56.533566 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6d9b655-f94a-4fe1-9697-a706a12a2852 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:56.534350 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6d9b655-f94a-4fe1-9697-a706a12a2852 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:56.534839 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6d9b655-f94a-4fe1-9697-a706a12a2852 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:56.714819 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e6d9b655-f94a-4fe1-9697-a706a12a2852 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:56.722534 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e6d9b655-f94a-4fe1-9697-a706a12a2852 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 200 len: 1314 microversion: 2.1 time: 0.201130 Dec 15 11:37:56.723141 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 479/956] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:56 2021] GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:57.740590 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-fba73aae-936d-4433-910e-60e8de9add8e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:57.741996 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-fba73aae-936d-4433-910e-60e8de9add8e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:57.750465 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fba73aae-936d-4433-910e-60e8de9add8e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:57.750946 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fba73aae-936d-4433-910e-60e8de9add8e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:57.751740 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fba73aae-936d-4433-910e-60e8de9add8e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:57.752179 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-fba73aae-936d-4433-910e-60e8de9add8e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:57.889884 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-fba73aae-936d-4433-910e-60e8de9add8e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:57.897328 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-fba73aae-936d-4433-910e-60e8de9add8e tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 200 len: 1497 microversion: 2.1 time: 0.161413 Dec 15 11:37:57.897901 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 478/957] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:57 2021] GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:58.303067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-439bc21e-4cf0-4323-a312-8000bafbeba6 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:58.303551 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-439bc21e-4cf0-4323-a312-8000bafbeba6 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:58.310407 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-439bc21e-4cf0-4323-a312-8000bafbeba6 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:58.310886 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-439bc21e-4cf0-4323-a312-8000bafbeba6 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:58.311688 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-439bc21e-4cf0-4323-a312-8000bafbeba6 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:58.312117 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-439bc21e-4cf0-4323-a312-8000bafbeba6 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:58.336147 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-439bc21e-4cf0-4323-a312-8000bafbeba6 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:37:58.409755 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-439bc21e-4cf0-4323-a312-8000bafbeba6 tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "DELETE /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 204 len: 0 microversion: 2.1 time: 0.110075 Dec 15 11:37:58.410692 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 480/958] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:37:58 2021] DELETE /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:37:58.419324 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5c7621a5-b479-4171-9a68-39fef29a6a0b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:58.420004 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5c7621a5-b479-4171-9a68-39fef29a6a0b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:58.425771 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5c7621a5-b479-4171-9a68-39fef29a6a0b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:58.426235 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5c7621a5-b479-4171-9a68-39fef29a6a0b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:58.427201 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5c7621a5-b479-4171-9a68-39fef29a6a0b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:58.427670 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5c7621a5-b479-4171-9a68-39fef29a6a0b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:58.562494 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-5c7621a5-b479-4171-9a68-39fef29a6a0b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:58.571137 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5c7621a5-b479-4171-9a68-39fef29a6a0b tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 200 len: 1503 microversion: 2.1 time: 0.156157 Dec 15 11:37:58.571735 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 479/959] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:58 2021] GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:37:59.589706 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3d1c6bc2-89cf-421b-bfda-7d07942d3f3a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:37:59.590403 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3d1c6bc2-89cf-421b-bfda-7d07942d3f3a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:37:59.596787 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3d1c6bc2-89cf-421b-bfda-7d07942d3f3a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:59.597230 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3d1c6bc2-89cf-421b-bfda-7d07942d3f3a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:59.598024 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3d1c6bc2-89cf-421b-bfda-7d07942d3f3a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:37:59.598461 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3d1c6bc2-89cf-421b-bfda-7d07942d3f3a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:37:59.736681 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3d1c6bc2-89cf-421b-bfda-7d07942d3f3a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eef4ab1c3447cfba6f8d02aa20fef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaa42d45f684fb7bb5458dc4538ced7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:37:59.745352 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3d1c6bc2-89cf-421b-bfda-7d07942d3f3a tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 200 len: 1503 microversion: 2.1 time: 0.160224 Dec 15 11:37:59.746949 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 481/960] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:37:59 2021] GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:00.311189 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-93e17573-53ef-4206-88a1-9687bdc7edcc req-675e762b-7cc7-48c9-bc0a-2c402d85dc83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656fa510-4569-4c84-9d4a-40b11d2a02cc", "name": "network-vif-deleted", "tag": "06628c1c-7df5-48fe-a8e7-d3b1b93347ee"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:38:00.312859 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:38:00.312859 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:38:00.323897 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-93e17573-53ef-4206-88a1-9687bdc7edcc req-675e762b-7cc7-48c9-bc0a-2c402d85dc83 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:00.324462 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-93e17573-53ef-4206-88a1-9687bdc7edcc req-675e762b-7cc7-48c9-bc0a-2c402d85dc83 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:00.341745 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-93e17573-53ef-4206-88a1-9687bdc7edcc req-675e762b-7cc7-48c9-bc0a-2c402d85dc83 service nova] Creating event network-vif-deleted:06628c1c-7df5-48fe-a8e7-d3b1b93347ee for instance 656fa510-4569-4c84-9d4a-40b11d2a02cc on hv-cinder-81321 Dec 15 11:38:00.353946 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-93e17573-53ef-4206-88a1-9687bdc7edcc req-675e762b-7cc7-48c9-bc0a-2c402d85dc83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044779 Dec 15 11:38:00.355150 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 480/961] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:38:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:38:00.770006 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-28fe5143-f26b-4866-adac-12edbc7673cd tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:00.772016 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-28fe5143-f26b-4866-adac-12edbc7673cd tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] [instance: 656fa510-4569-4c84-9d4a-40b11d2a02cc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:00.780650 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28fe5143-f26b-4866-adac-12edbc7673cd tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:00.781099 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28fe5143-f26b-4866-adac-12edbc7673cd tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:00.781889 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28fe5143-f26b-4866-adac-12edbc7673cd tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:00.782347 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28fe5143-f26b-4866-adac-12edbc7673cd tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:00.800006 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-28fe5143-f26b-4866-adac-12edbc7673cd tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] HTTP exception thrown: Instance 656fa510-4569-4c84-9d4a-40b11d2a02cc could not be found. Dec 15 11:38:00.800800 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-28fe5143-f26b-4866-adac-12edbc7673cd tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] Returning 404 to user: Instance 656fa510-4569-4c84-9d4a-40b11d2a02cc could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:38:00.801629 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-28fe5143-f26b-4866-adac-12edbc7673cd tempest-VolumesActionsTest-1019057329 tempest-VolumesActionsTest-1019057329-project] 10.222.0.18 "GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc" status: 404 len: 111 microversion: 2.1 time: 0.041813 Dec 15 11:38:00.802341 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 482/962] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:00 2021] GET /compute/v2.1/servers/656fa510-4569-4c84-9d4a-40b11d2a02cc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:38:02.204840 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1361544727", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "networks": [{"uuid": "43e3e8e0-0170-48f8-b66f-e76cbab948c4"}]}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:38:02.262800 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.network.neutron [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] validate_networks() for [('43e3e8e0-0170-48f8-b66f-e76cbab948c4', None, None, None, None, None)] {{(pid=116082) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:38:02.601771 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Flavor limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:38:02.602191 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Image limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:38:02.603345 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Flavor pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:38:02.603883 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Image pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:38:02.604295 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:38:02.612823 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:02.613322 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:02.614134 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:02.614590 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:02.631471 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Getting quotas for project 6ff93e8f116741609e6914e602f4d118. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:38:02.635509 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Getting quotas for user 9687c82971da4f129b0e90662784d869 and project 6ff93e8f116741609e6914e602f4d118. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:38:02.646040 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Going to run 1 instances... {{(pid=116082) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:38:02.648415 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116082) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:38:02.696408 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7c1cf5ee-5a2d-4490-8496-89414e34c4bd tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495395 Dec 15 11:38:02.697152 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 481/963] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:38:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:38:02.707037 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-86ff715b-9023-413f-9a52-f913f0a7a2af tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:02.707643 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-86ff715b-9023-413f-9a52-f913f0a7a2af tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:02.761136 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-86ff715b-9023-413f-9a52-f913f0a7a2af tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:02.767619 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-86ff715b-9023-413f-9a52-f913f0a7a2af tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1219 microversion: 2.1 time: 0.064435 Dec 15 11:38:02.768314 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 483/964] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:02 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:03.783720 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4f90b28c-d8ef-4cd8-810c-91de339895a3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:03.784332 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4f90b28c-d8ef-4cd8-810c-91de339895a3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:03.791031 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4f90b28c-d8ef-4cd8-810c-91de339895a3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:03.791486 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4f90b28c-d8ef-4cd8-810c-91de339895a3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:03.792269 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4f90b28c-d8ef-4cd8-810c-91de339895a3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:03.792713 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4f90b28c-d8ef-4cd8-810c-91de339895a3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:03.858000 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4f90b28c-d8ef-4cd8-810c-91de339895a3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:03.865401 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4f90b28c-d8ef-4cd8-810c-91de339895a3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1223 microversion: 2.1 time: 0.085398 Dec 15 11:38:03.865964 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 482/965] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:03 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:04.882441 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b600efa0-afee-4aa8-8d67-0d2461855979 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:04.883081 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b600efa0-afee-4aa8-8d67-0d2461855979 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:04.890815 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b600efa0-afee-4aa8-8d67-0d2461855979 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:04.891261 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b600efa0-afee-4aa8-8d67-0d2461855979 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:04.892042 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b600efa0-afee-4aa8-8d67-0d2461855979 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:04.892473 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b600efa0-afee-4aa8-8d67-0d2461855979 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:04.954641 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b600efa0-afee-4aa8-8d67-0d2461855979 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:04.962447 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b600efa0-afee-4aa8-8d67-0d2461855979 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1271 microversion: 2.1 time: 0.083090 Dec 15 11:38:04.963327 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 484/966] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:04 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:05.985043 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-930bc812-8f8d-4a12-8ed4-610c62d4b247 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:05.986482 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-930bc812-8f8d-4a12-8ed4-610c62d4b247 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:06.013668 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-930bc812-8f8d-4a12-8ed4-610c62d4b247 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:06.014440 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-930bc812-8f8d-4a12-8ed4-610c62d4b247 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:06.015489 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-930bc812-8f8d-4a12-8ed4-610c62d4b247 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:06.016090 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-930bc812-8f8d-4a12-8ed4-610c62d4b247 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:06.326857 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-930bc812-8f8d-4a12-8ed4-610c62d4b247 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:06.336567 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-930bc812-8f8d-4a12-8ed4-610c62d4b247 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1319 microversion: 2.1 time: 0.357518 Dec 15 11:38:06.348688 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 483/967] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:05 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:06.834580 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-acb73568-ba8c-4236-88b2-49c76d2bb2f1 req-f1ca1854-dcb6-432a-885d-89eef974853a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdca5a64-95a2-428d-b59c-7997687d7c8b", "tag": "a37b2049-50ba-4323-b1e1-2ee0a99f3100"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:38:06.840460 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:38:06.840460 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:38:06.850945 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-acb73568-ba8c-4236-88b2-49c76d2bb2f1 req-f1ca1854-dcb6-432a-885d-89eef974853a service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:06.851776 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-acb73568-ba8c-4236-88b2-49c76d2bb2f1 req-f1ca1854-dcb6-432a-885d-89eef974853a service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:06.876287 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-acb73568-ba8c-4236-88b2-49c76d2bb2f1 req-f1ca1854-dcb6-432a-885d-89eef974853a service nova] Creating event network-changed:a37b2049-50ba-4323-b1e1-2ee0a99f3100 for instance cdca5a64-95a2-428d-b59c-7997687d7c8b on hv-cinder-81321 Dec 15 11:38:06.884618 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-acb73568-ba8c-4236-88b2-49c76d2bb2f1 req-f1ca1854-dcb6-432a-885d-89eef974853a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207298 Dec 15 11:38:06.886490 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 485/968] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:38:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:38:07.356872 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2c33d55f-c9a3-4098-afde-5621a474e9ef tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:07.358452 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2c33d55f-c9a3-4098-afde-5621a474e9ef tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:07.365810 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2c33d55f-c9a3-4098-afde-5621a474e9ef tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:07.366604 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2c33d55f-c9a3-4098-afde-5621a474e9ef tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:07.367635 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2c33d55f-c9a3-4098-afde-5621a474e9ef tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:07.369016 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2c33d55f-c9a3-4098-afde-5621a474e9ef tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:07.714160 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2c33d55f-c9a3-4098-afde-5621a474e9ef tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:07.725105 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2c33d55f-c9a3-4098-afde-5621a474e9ef tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1319 microversion: 2.1 time: 0.372468 Dec 15 11:38:07.726157 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 484/969] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:07 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:08.748663 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a8818c94-1c63-4d74-b2e0-68b2917d4225 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:08.749371 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a8818c94-1c63-4d74-b2e0-68b2917d4225 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:08.755937 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8818c94-1c63-4d74-b2e0-68b2917d4225 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:08.756370 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8818c94-1c63-4d74-b2e0-68b2917d4225 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:08.757150 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8818c94-1c63-4d74-b2e0-68b2917d4225 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:08.757593 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8818c94-1c63-4d74-b2e0-68b2917d4225 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:08.916543 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a8818c94-1c63-4d74-b2e0-68b2917d4225 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:08.924440 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a8818c94-1c63-4d74-b2e0-68b2917d4225 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1319 microversion: 2.1 time: 0.179836 Dec 15 11:38:08.925239 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 486/970] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:08 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:09.943168 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-179a379a-f621-4f15-b0f0-6ba98f6cf944 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:09.943794 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-179a379a-f621-4f15-b0f0-6ba98f6cf944 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:09.952306 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-179a379a-f621-4f15-b0f0-6ba98f6cf944 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:09.953073 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-179a379a-f621-4f15-b0f0-6ba98f6cf944 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:09.954099 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-179a379a-f621-4f15-b0f0-6ba98f6cf944 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:09.954599 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-179a379a-f621-4f15-b0f0-6ba98f6cf944 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:10.101285 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-179a379a-f621-4f15-b0f0-6ba98f6cf944 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:10.111264 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-179a379a-f621-4f15-b0f0-6ba98f6cf944 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1319 microversion: 2.1 time: 0.171648 Dec 15 11:38:10.112046 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 485/971] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:09 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:11.128695 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2bdc2719-b0e0-4584-8d42-e2f559d3c51d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:11.129292 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2bdc2719-b0e0-4584-8d42-e2f559d3c51d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:11.139374 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bdc2719-b0e0-4584-8d42-e2f559d3c51d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:11.139818 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bdc2719-b0e0-4584-8d42-e2f559d3c51d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:11.140606 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bdc2719-b0e0-4584-8d42-e2f559d3c51d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:11.141035 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bdc2719-b0e0-4584-8d42-e2f559d3c51d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:11.449996 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2bdc2719-b0e0-4584-8d42-e2f559d3c51d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:11.458305 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2bdc2719-b0e0-4584-8d42-e2f559d3c51d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1319 microversion: 2.1 time: 0.333050 Dec 15 11:38:11.462166 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 487/972] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:11 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:12.476200 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-8ac7b590-1803-4398-a986-75b045aa78b1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:12.478069 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-8ac7b590-1803-4398-a986-75b045aa78b1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:12.485472 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8ac7b590-1803-4398-a986-75b045aa78b1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:12.486286 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8ac7b590-1803-4398-a986-75b045aa78b1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:12.487327 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8ac7b590-1803-4398-a986-75b045aa78b1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:12.488032 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-8ac7b590-1803-4398-a986-75b045aa78b1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:12.651966 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-8ac7b590-1803-4398-a986-75b045aa78b1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:12.655124 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-c5db38a6-a13b-467b-b9c8-7f3532605a8f req-6ee2519a-95af-4a57-8a96-74f7ee724cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdca5a64-95a2-428d-b59c-7997687d7c8b", "name": "network-vif-plugged", "status": "completed", "tag": "a37b2049-50ba-4323-b1e1-2ee0a99f3100"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:38:12.659006 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:38:12.659006 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:38:12.663844 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-8ac7b590-1803-4398-a986-75b045aa78b1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1319 microversion: 2.1 time: 0.189743 Dec 15 11:38:12.669160 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-c5db38a6-a13b-467b-b9c8-7f3532605a8f req-6ee2519a-95af-4a57-8a96-74f7ee724cda service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:12.669899 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-c5db38a6-a13b-467b-b9c8-7f3532605a8f req-6ee2519a-95af-4a57-8a96-74f7ee724cda service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:12.676340 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 486/973] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:12 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:12.683599 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-c5db38a6-a13b-467b-b9c8-7f3532605a8f req-6ee2519a-95af-4a57-8a96-74f7ee724cda service nova] Creating event network-vif-plugged:a37b2049-50ba-4323-b1e1-2ee0a99f3100 for instance cdca5a64-95a2-428d-b59c-7997687d7c8b on hv-cinder-81321 Dec 15 11:38:12.688986 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-c5db38a6-a13b-467b-b9c8-7f3532605a8f req-6ee2519a-95af-4a57-8a96-74f7ee724cda service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039647 Dec 15 11:38:12.689869 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 488/974] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:38:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 11:38:13.681894 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-65448ff7-2911-43df-830d-d0e67f9a9a6c tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:13.682578 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-65448ff7-2911-43df-830d-d0e67f9a9a6c tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:13.689416 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65448ff7-2911-43df-830d-d0e67f9a9a6c tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:13.689918 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65448ff7-2911-43df-830d-d0e67f9a9a6c tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:13.690972 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65448ff7-2911-43df-830d-d0e67f9a9a6c tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:13.691740 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-65448ff7-2911-43df-830d-d0e67f9a9a6c tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:13.858150 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-65448ff7-2911-43df-830d-d0e67f9a9a6c tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:13.883334 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-65448ff7-2911-43df-830d-d0e67f9a9a6c tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1319 microversion: 2.1 time: 0.202193 Dec 15 11:38:13.884212 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 487/975] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:13 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:14.902191 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ac708acf-88ac-4f02-bd3c-a6ebfc26c1e3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:14.903875 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ac708acf-88ac-4f02-bd3c-a6ebfc26c1e3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:14.910916 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac708acf-88ac-4f02-bd3c-a6ebfc26c1e3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:14.911658 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac708acf-88ac-4f02-bd3c-a6ebfc26c1e3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:14.912646 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac708acf-88ac-4f02-bd3c-a6ebfc26c1e3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:14.913295 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ac708acf-88ac-4f02-bd3c-a6ebfc26c1e3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:15.055803 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ac708acf-88ac-4f02-bd3c-a6ebfc26c1e3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:15.064543 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ac708acf-88ac-4f02-bd3c-a6ebfc26c1e3 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1508 microversion: 2.1 time: 0.167185 Dec 15 11:38:15.065238 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 489/976] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:14 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:25.959939 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:38:25.959939 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:38:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 11:38:35.543583 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-452144d8-8e5f-4e95-92e7-963743815fad tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de842e7e-8ad9-43f1-b94f-bd4f956c93cc", "device": "/dev/sdb"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:38:35.546099 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-452144d8-8e5f-4e95-92e7-963743815fad tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:35.555155 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-452144d8-8e5f-4e95-92e7-963743815fad tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:35.556109 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-452144d8-8e5f-4e95-92e7-963743815fad tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:35.557693 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-452144d8-8e5f-4e95-92e7-963743815fad tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:35.558373 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-452144d8-8e5f-4e95-92e7-963743815fad tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:35.795065 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-452144d8-8e5f-4e95-92e7-963743815fad tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "POST /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256944 Dec 15 11:38:35.795693 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 488/977] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:38:35 2021] POST /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:38:40.032783 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-a820b0e9-4bc3-4bdd-b20c-ac95c006e0e8 req-2bfd7dcc-b4ee-45e4-b8bd-1316364943c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3f31c4-e258-4bb7-a7c9-795cf3c302af", "tag": "fdd01109-ae47-4e03-a1ac-0a3119e113ea"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:38:40.033643 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-971344a9-d3e6-4ea6-a72a-c5bb519530e0 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:40.034164 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-971344a9-d3e6-4ea6-a72a-c5bb519530e0 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:40.034548 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:38:40.034548 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:38:40.042506 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-971344a9-d3e6-4ea6-a72a-c5bb519530e0 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:40.043008 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-971344a9-d3e6-4ea6-a72a-c5bb519530e0 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:40.043806 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-971344a9-d3e6-4ea6-a72a-c5bb519530e0 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:40.044245 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-971344a9-d3e6-4ea6-a72a-c5bb519530e0 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:40.049218 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-a820b0e9-4bc3-4bdd-b20c-ac95c006e0e8 req-2bfd7dcc-b4ee-45e4-b8bd-1316364943c7 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:40.049809 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-a820b0e9-4bc3-4bdd-b20c-ac95c006e0e8 req-2bfd7dcc-b4ee-45e4-b8bd-1316364943c7 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:40.069952 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-971344a9-d3e6-4ea6-a72a-c5bb519530e0 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:38:40.075311 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-a820b0e9-4bc3-4bdd-b20c-ac95c006e0e8 req-2bfd7dcc-b4ee-45e4-b8bd-1316364943c7 service nova] Creating event network-changed:fdd01109-ae47-4e03-a1ac-0a3119e113ea for instance ef3f31c4-e258-4bb7-a7c9-795cf3c302af on hv-cinder-81321 Dec 15 11:38:40.085055 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-a820b0e9-4bc3-4bdd-b20c-ac95c006e0e8 req-2bfd7dcc-b4ee-45e4-b8bd-1316364943c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058593 Dec 15 11:38:40.086632 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 489/978] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:38:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:38:40.152705 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-971344a9-d3e6-4ea6-a72a-c5bb519530e0 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 204 len: 0 microversion: 2.1 time: 0.129521 Dec 15 11:38:40.153667 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 490/979] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:38:40 2021] DELETE /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:38:40.163657 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b49b5d58-c75d-41f8-bbb4-ca4dffe51640 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:40.164661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b49b5d58-c75d-41f8-bbb4-ca4dffe51640 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:40.172147 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b49b5d58-c75d-41f8-bbb4-ca4dffe51640 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:40.172595 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b49b5d58-c75d-41f8-bbb4-ca4dffe51640 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:40.173379 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b49b5d58-c75d-41f8-bbb4-ca4dffe51640 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:40.173809 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b49b5d58-c75d-41f8-bbb4-ca4dffe51640 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:40.441933 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b49b5d58-c75d-41f8-bbb4-ca4dffe51640 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:40.450098 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b49b5d58-c75d-41f8-bbb4-ca4dffe51640 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1568 microversion: 2.1 time: 0.291865 Dec 15 11:38:40.461001 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 490/980] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:40 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1568 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:41.468808 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b250f836-d85e-4576-b34a-f76894011a8f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:41.469508 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b250f836-d85e-4576-b34a-f76894011a8f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:41.476223 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b250f836-d85e-4576-b34a-f76894011a8f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:41.476681 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b250f836-d85e-4576-b34a-f76894011a8f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:41.477491 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b250f836-d85e-4576-b34a-f76894011a8f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:41.477931 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b250f836-d85e-4576-b34a-f76894011a8f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:41.617510 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b250f836-d85e-4576-b34a-f76894011a8f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:41.625227 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b250f836-d85e-4576-b34a-f76894011a8f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1450 microversion: 2.1 time: 0.160390 Dec 15 11:38:41.625866 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 491/981] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:41 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:42.363643 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-453826d2-0c38-4d05-8639-97955c16ca46 req-2f0d1578-dd62-4f44-a8de-9fb287d001bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3f31c4-e258-4bb7-a7c9-795cf3c302af", "name": "network-vif-deleted", "tag": "fdd01109-ae47-4e03-a1ac-0a3119e113ea"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:38:42.365987 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:38:42.365987 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:38:42.374262 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-453826d2-0c38-4d05-8639-97955c16ca46 req-2f0d1578-dd62-4f44-a8de-9fb287d001bc service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:42.374743 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-453826d2-0c38-4d05-8639-97955c16ca46 req-2f0d1578-dd62-4f44-a8de-9fb287d001bc service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:42.387533 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-453826d2-0c38-4d05-8639-97955c16ca46 req-2f0d1578-dd62-4f44-a8de-9fb287d001bc service nova] Creating event network-vif-deleted:fdd01109-ae47-4e03-a1ac-0a3119e113ea for instance ef3f31c4-e258-4bb7-a7c9-795cf3c302af on hv-cinder-81321 Dec 15 11:38:42.392606 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-453826d2-0c38-4d05-8639-97955c16ca46 req-2f0d1578-dd62-4f44-a8de-9fb287d001bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033555 Dec 15 11:38:42.393193 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 491/982] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:38:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:38:42.643405 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0ad28146-3112-4f59-90ae-a70af9e84a7f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:42.644078 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0ad28146-3112-4f59-90ae-a70af9e84a7f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:42.651248 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ad28146-3112-4f59-90ae-a70af9e84a7f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:42.651696 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ad28146-3112-4f59-90ae-a70af9e84a7f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:42.652491 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ad28146-3112-4f59-90ae-a70af9e84a7f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:42.652926 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ad28146-3112-4f59-90ae-a70af9e84a7f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:42.714516 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0ad28146-3112-4f59-90ae-a70af9e84a7f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3d4afb45294feb8c7f61d0abfd1334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33910c71a6444d4a48fe8455c0736d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:38:42.722284 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0ad28146-3112-4f59-90ae-a70af9e84a7f tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 200 len: 1219 microversion: 2.1 time: 0.082592 Dec 15 11:38:42.723208 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 492/983] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:42 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:38:43.741350 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-78f3d76b-a77d-4556-89fc-fae89d193573 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:43.742687 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-78f3d76b-a77d-4556-89fc-fae89d193573 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] [instance: ef3f31c4-e258-4bb7-a7c9-795cf3c302af] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:38:43.748999 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78f3d76b-a77d-4556-89fc-fae89d193573 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:43.749447 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78f3d76b-a77d-4556-89fc-fae89d193573 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:43.750258 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78f3d76b-a77d-4556-89fc-fae89d193573 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:38:43.750726 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78f3d76b-a77d-4556-89fc-fae89d193573 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:38:43.763907 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-78f3d76b-a77d-4556-89fc-fae89d193573 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] HTTP exception thrown: Instance ef3f31c4-e258-4bb7-a7c9-795cf3c302af could not be found. Dec 15 11:38:43.764488 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-78f3d76b-a77d-4556-89fc-fae89d193573 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Returning 404 to user: Instance ef3f31c4-e258-4bb7-a7c9-795cf3c302af could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:38:43.765304 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-78f3d76b-a77d-4556-89fc-fae89d193573 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af" status: 404 len: 111 microversion: 2.1 time: 0.028871 Dec 15 11:38:43.765823 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 492/984] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:38:43 2021] GET /compute/v2.1/servers/ef3f31c4-e258-4bb7-a7c9-795cf3c302af => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:38:43.928419 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7aa27e08-a7a2-4a0f-8421-001ff9ce25c6 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] Calling method '.version_select at 0x7fdf599591f0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:38:43.953442 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7aa27e08-a7a2-4a0f-8421-001ff9ce25c6 tempest-TestShelveInstance-903523027 tempest-TestShelveInstance-903523027-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-199429054" status: 202 len: 0 microversion: 2.1 time: 0.029112 Dec 15 11:38:43.954276 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 493/985] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 11:38:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-199429054 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:39:01.515214 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e2aff923-14aa-4515-9b14-44221f3be65d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:01.515741 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e2aff923-14aa-4515-9b14-44221f3be65d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:01.521905 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e2aff923-14aa-4515-9b14-44221f3be65d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:01.522355 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e2aff923-14aa-4515-9b14-44221f3be65d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:01.523178 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e2aff923-14aa-4515-9b14-44221f3be65d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:01.523646 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e2aff923-14aa-4515-9b14-44221f3be65d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:01.607242 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-e2aff923-14aa-4515-9b14-44221f3be65d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lazy-loading 'services' on Instance uuid cdca5a64-95a2-428d-b59c-7997687d7c8b {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:39:01.675865 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e2aff923-14aa-4515-9b14-44221f3be65d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b/os-volume_attachments/de842e7e-8ad9-43f1-b94f-bd4f956c93cc" status: 202 len: 0 microversion: 2.1 time: 0.164154 Dec 15 11:39:01.676476 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 493/986] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:39:01 2021] DELETE /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b/os-volume_attachments/de842e7e-8ad9-43f1-b94f-bd4f956c93cc => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:39:08.048565 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4f52e1af-694f-4c48-a68e-b135e3ec828d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:08.049159 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4f52e1af-694f-4c48-a68e-b135e3ec828d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:08.057780 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f52e1af-694f-4c48-a68e-b135e3ec828d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:08.058227 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f52e1af-694f-4c48-a68e-b135e3ec828d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:08.059043 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f52e1af-694f-4c48-a68e-b135e3ec828d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:08.059482 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f52e1af-694f-4c48-a68e-b135e3ec828d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:08.083938 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4f52e1af-694f-4c48-a68e-b135e3ec828d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:39:08.152998 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4f52e1af-694f-4c48-a68e-b135e3ec828d tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 204 len: 0 microversion: 2.1 time: 0.108415 Dec 15 11:39:08.153565 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 494/987] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:39:08 2021] DELETE /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 11:39:08.162370 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0dc64d44-84be-4b5b-ab09-0b1769d9f479 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:08.163213 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-0dc64d44-84be-4b5b-ab09-0b1769d9f479 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:08.171074 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0dc64d44-84be-4b5b-ab09-0b1769d9f479 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:08.171521 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0dc64d44-84be-4b5b-ab09-0b1769d9f479 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:08.172336 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0dc64d44-84be-4b5b-ab09-0b1769d9f479 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:08.172771 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0dc64d44-84be-4b5b-ab09-0b1769d9f479 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:08.311984 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-0dc64d44-84be-4b5b-ab09-0b1769d9f479 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:08.319423 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0dc64d44-84be-4b5b-ab09-0b1769d9f479 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1514 microversion: 2.1 time: 0.161468 Dec 15 11:39:08.319989 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 494/988] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:08 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:08.758172 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1449351106", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:39:08.807490 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] validate_networks() for None {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:39:09.073032 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:39:09.073602 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:39:09.073904 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:39:09.074301 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:39:09.074743 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:39:09.083766 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:09.084207 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:09.085006 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:09.085433 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:09.106191 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Getting quotas for project 8af67185dd56476c8155a9943c05156c. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:39:09.110046 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Getting quotas for user 8831179a619a4673899b6220b09cc89f and project 8af67185dd56476c8155a9943c05156c. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:39:09.120704 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:39:09.123067 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:39:09.166331 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7072be40-3dc3-493e-8617-33b95d3a4832 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.412223 Dec 15 11:39:09.167016 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 495/989] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:39:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:39:09.181282 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-008df21f-2b61-45b1-8702-2c9ff1013459 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:09.182323 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-008df21f-2b61-45b1-8702-2c9ff1013459 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:09.238519 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-008df21f-2b61-45b1-8702-2c9ff1013459 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:09.247828 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-008df21f-2b61-45b1-8702-2c9ff1013459 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1215 microversion: 2.1 time: 0.074685 Dec 15 11:39:09.248555 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 495/990] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:09 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:09.336931 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6e5298ec-f0f8-4c56-840c-d8c8f4e2a30f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:09.337780 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6e5298ec-f0f8-4c56-840c-d8c8f4e2a30f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:09.344270 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e5298ec-f0f8-4c56-840c-d8c8f4e2a30f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:09.344741 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e5298ec-f0f8-4c56-840c-d8c8f4e2a30f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:09.345579 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e5298ec-f0f8-4c56-840c-d8c8f4e2a30f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:09.346012 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e5298ec-f0f8-4c56-840c-d8c8f4e2a30f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:09.488018 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6e5298ec-f0f8-4c56-840c-d8c8f4e2a30f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:09.496304 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6e5298ec-f0f8-4c56-840c-d8c8f4e2a30f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1514 microversion: 2.1 time: 0.163588 Dec 15 11:39:09.496854 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 496/991] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:09 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:10.249085 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-b86f3fe5-fb5a-4d5a-b99d-83026351bb9f req-a8377b9b-13f4-40ce-82d3-bafb2b42e00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdca5a64-95a2-428d-b59c-7997687d7c8b", "name": "network-vif-deleted", "tag": "a37b2049-50ba-4323-b1e1-2ee0a99f3100"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:39:10.250902 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:39:10.250902 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:39:10.260697 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-b86f3fe5-fb5a-4d5a-b99d-83026351bb9f req-a8377b9b-13f4-40ce-82d3-bafb2b42e00c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:10.261241 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-b86f3fe5-fb5a-4d5a-b99d-83026351bb9f req-a8377b9b-13f4-40ce-82d3-bafb2b42e00c service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:10.268916 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0f40014b-cd44-43d6-9036-5419af2758b8 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:10.269606 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0f40014b-cd44-43d6-9036-5419af2758b8 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:10.278665 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f40014b-cd44-43d6-9036-5419af2758b8 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:10.279203 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f40014b-cd44-43d6-9036-5419af2758b8 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:10.280159 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f40014b-cd44-43d6-9036-5419af2758b8 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:10.280608 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f40014b-cd44-43d6-9036-5419af2758b8 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:10.290148 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-b86f3fe5-fb5a-4d5a-b99d-83026351bb9f req-a8377b9b-13f4-40ce-82d3-bafb2b42e00c service nova] Creating event network-vif-deleted:a37b2049-50ba-4323-b1e1-2ee0a99f3100 for instance cdca5a64-95a2-428d-b59c-7997687d7c8b on hv-cinder-81321 Dec 15 11:39:10.295609 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-b86f3fe5-fb5a-4d5a-b99d-83026351bb9f req-a8377b9b-13f4-40ce-82d3-bafb2b42e00c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051391 Dec 15 11:39:10.296310 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 496/992] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:39:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:39:10.368061 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0f40014b-cd44-43d6-9036-5419af2758b8 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:10.375423 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0f40014b-cd44-43d6-9036-5419af2758b8 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1273 microversion: 2.1 time: 0.110063 Dec 15 11:39:10.375992 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 497/993] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:10 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:10.514559 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-db7012e5-e99a-4c1f-8789-10000eb4eef7 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:10.515408 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-db7012e5-e99a-4c1f-8789-10000eb4eef7 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:10.521596 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-db7012e5-e99a-4c1f-8789-10000eb4eef7 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:10.522123 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-db7012e5-e99a-4c1f-8789-10000eb4eef7 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:10.523021 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-db7012e5-e99a-4c1f-8789-10000eb4eef7 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:10.523660 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-db7012e5-e99a-4c1f-8789-10000eb4eef7 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:10.554174 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-db7012e5-e99a-4c1f-8789-10000eb4eef7 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:10.555385 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-db7012e5-e99a-4c1f-8789-10000eb4eef7 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:10.556647 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-db7012e5-e99a-4c1f-8789-10000eb4eef7 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lazy-loading 'fault' on Instance uuid cdca5a64-95a2-428d-b59c-7997687d7c8b {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:39:10.603348 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-db7012e5-e99a-4c1f-8789-10000eb4eef7 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:10.611374 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-db7012e5-e99a-4c1f-8789-10000eb4eef7 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 200 len: 1309 microversion: 2.1 time: 0.101019 Dec 15 11:39:10.611938 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 497/994] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:10 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:11.393164 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b22df5bc-bf15-4466-b266-3646796c42bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:11.394706 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b22df5bc-bf15-4466-b266-3646796c42bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:11.401540 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b22df5bc-bf15-4466-b266-3646796c42bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:11.402255 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b22df5bc-bf15-4466-b266-3646796c42bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:11.403725 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b22df5bc-bf15-4466-b266-3646796c42bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:11.404201 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b22df5bc-bf15-4466-b266-3646796c42bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:11.618396 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-b963fe30-7b8f-4735-b0fc-357242b97aa5 req-51bbaee6-5382-4742-a9d6-3744efee8edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb837c69-e994-4c61-baac-c931c5c8e5ba", "tag": "f4e18fbc-c4ab-46e9-805c-4d98dd6b3ea9"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:39:11.620681 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:39:11.620681 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:39:11.630159 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-b963fe30-7b8f-4735-b0fc-357242b97aa5 req-51bbaee6-5382-4742-a9d6-3744efee8edb service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:11.631147 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-b963fe30-7b8f-4735-b0fc-357242b97aa5 req-51bbaee6-5382-4742-a9d6-3744efee8edb service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:11.643351 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-b963fe30-7b8f-4735-b0fc-357242b97aa5 req-51bbaee6-5382-4742-a9d6-3744efee8edb service nova] Creating event network-changed:f4e18fbc-c4ab-46e9-805c-4d98dd6b3ea9 for instance eb837c69-e994-4c61-baac-c931c5c8e5ba on hv-cinder-81321 Dec 15 11:39:11.650374 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-b963fe30-7b8f-4735-b0fc-357242b97aa5 req-51bbaee6-5382-4742-a9d6-3744efee8edb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038499 Dec 15 11:39:11.654209 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b22df5bc-bf15-4466-b266-3646796c42bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:11.657407 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 498/995] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:39:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:39:11.663321 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b22df5bc-bf15-4466-b266-3646796c42bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1315 microversion: 2.1 time: 0.273989 Dec 15 11:39:11.665012 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 498/996] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:11 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:11.671458 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e77727be-1624-4539-beb0-7f7b2efe4890 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:11.672412 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-e77727be-1624-4539-beb0-7f7b2efe4890 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: cdca5a64-95a2-428d-b59c-7997687d7c8b] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:11.680527 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e77727be-1624-4539-beb0-7f7b2efe4890 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:11.681259 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e77727be-1624-4539-beb0-7f7b2efe4890 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:11.682982 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e77727be-1624-4539-beb0-7f7b2efe4890 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:11.683751 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-e77727be-1624-4539-beb0-7f7b2efe4890 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:11.701064 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-e77727be-1624-4539-beb0-7f7b2efe4890 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] HTTP exception thrown: Instance cdca5a64-95a2-428d-b59c-7997687d7c8b could not be found. Dec 15 11:39:11.701672 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-e77727be-1624-4539-beb0-7f7b2efe4890 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Returning 404 to user: Instance cdca5a64-95a2-428d-b59c-7997687d7c8b could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:39:11.702520 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-e77727be-1624-4539-beb0-7f7b2efe4890 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b" status: 404 len: 111 microversion: 2.1 time: 0.041911 Dec 15 11:39:11.703114 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 499/997] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:11 2021] GET /compute/v2.1/servers/cdca5a64-95a2-428d-b59c-7997687d7c8b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:39:12.684081 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5f561fb2-9566-4c13-bcdd-60d8bfc90250 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:12.684693 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5f561fb2-9566-4c13-bcdd-60d8bfc90250 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:12.690982 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5f561fb2-9566-4c13-bcdd-60d8bfc90250 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:12.691451 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5f561fb2-9566-4c13-bcdd-60d8bfc90250 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:12.692221 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5f561fb2-9566-4c13-bcdd-60d8bfc90250 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:12.692644 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5f561fb2-9566-4c13-bcdd-60d8bfc90250 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:12.824818 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5f561fb2-9566-4c13-bcdd-60d8bfc90250 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:12.832301 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5f561fb2-9566-4c13-bcdd-60d8bfc90250 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1315 microversion: 2.1 time: 0.152476 Dec 15 11:39:12.832870 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 499/998] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:12 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:13.849867 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a81b0267-df86-43e0-bb21-ca12442b67a2 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:13.850502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a81b0267-df86-43e0-bb21-ca12442b67a2 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:13.857285 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a81b0267-df86-43e0-bb21-ca12442b67a2 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:13.857728 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a81b0267-df86-43e0-bb21-ca12442b67a2 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:13.858494 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a81b0267-df86-43e0-bb21-ca12442b67a2 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:13.858958 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-a81b0267-df86-43e0-bb21-ca12442b67a2 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:13.986326 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a81b0267-df86-43e0-bb21-ca12442b67a2 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:13.994096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a81b0267-df86-43e0-bb21-ca12442b67a2 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1315 microversion: 2.1 time: 0.147934 Dec 15 11:39:13.994673 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 500/999] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:13 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:15.014220 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2bb6ac7d-fd6d-41dc-b84d-b93994a1d04d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:15.014220 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2bb6ac7d-fd6d-41dc-b84d-b93994a1d04d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:15.018897 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bb6ac7d-fd6d-41dc-b84d-b93994a1d04d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:15.019504 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bb6ac7d-fd6d-41dc-b84d-b93994a1d04d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:15.020176 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bb6ac7d-fd6d-41dc-b84d-b93994a1d04d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:15.020523 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bb6ac7d-fd6d-41dc-b84d-b93994a1d04d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:15.166424 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2bb6ac7d-fd6d-41dc-b84d-b93994a1d04d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:15.174652 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2bb6ac7d-fd6d-41dc-b84d-b93994a1d04d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1315 microversion: 2.1 time: 0.167894 Dec 15 11:39:15.175357 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 500/1000] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:15 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:39:16.192271 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-3e496e9f-f5cc-48f4-8e4c-0547adc70176 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:16.192910 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-3e496e9f-f5cc-48f4-8e4c-0547adc70176 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:16.199481 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e496e9f-f5cc-48f4-8e4c-0547adc70176 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:16.199933 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e496e9f-f5cc-48f4-8e4c-0547adc70176 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:16.200723 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e496e9f-f5cc-48f4-8e4c-0547adc70176 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:16.201159 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-3e496e9f-f5cc-48f4-8e4c-0547adc70176 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:16.337535 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-3e496e9f-f5cc-48f4-8e4c-0547adc70176 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:16.344743 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-3e496e9f-f5cc-48f4-8e4c-0547adc70176 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1315 microversion: 2.1 time: 0.156382 Dec 15 11:39:16.345360 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 501/1001] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:16 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:17.360851 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-010e84cb-7905-4903-a16c-6f036e80174d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:17.361455 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-010e84cb-7905-4903-a16c-6f036e80174d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:17.368356 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-010e84cb-7905-4903-a16c-6f036e80174d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:17.368798 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-010e84cb-7905-4903-a16c-6f036e80174d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:17.369603 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-010e84cb-7905-4903-a16c-6f036e80174d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:17.370025 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-010e84cb-7905-4903-a16c-6f036e80174d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:17.502906 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-010e84cb-7905-4903-a16c-6f036e80174d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:17.510203 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-010e84cb-7905-4903-a16c-6f036e80174d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1315 microversion: 2.1 time: 0.152907 Dec 15 11:39:17.510793 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 501/1002] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:17 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:18.526878 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-b5829cdb-82e8-4cae-8332-a36406b4e340 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:18.527497 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-b5829cdb-82e8-4cae-8332-a36406b4e340 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:18.533807 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b5829cdb-82e8-4cae-8332-a36406b4e340 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:18.534271 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b5829cdb-82e8-4cae-8332-a36406b4e340 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:18.535121 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b5829cdb-82e8-4cae-8332-a36406b4e340 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:18.535597 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-b5829cdb-82e8-4cae-8332-a36406b4e340 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:18.674841 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-b5829cdb-82e8-4cae-8332-a36406b4e340 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:18.683012 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-b5829cdb-82e8-4cae-8332-a36406b4e340 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1315 microversion: 2.1 time: 0.160079 Dec 15 11:39:18.683581 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 502/1003] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:18 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:19.479013 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-95759515", "imageRef": "03786c1a-01dc-4180-a23f-dc99d0afebc1", "flavorRef": "452", "networks": [{"uuid": "43e3e8e0-0170-48f8-b66f-e76cbab948c4"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:39:19.529716 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] validate_networks() for [('43e3e8e0-0170-48f8-b66f-e76cbab948c4', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:39:19.699140 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7b89d8b6-0c06-4a8e-92df-229f991739eb tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:19.699990 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7b89d8b6-0c06-4a8e-92df-229f991739eb tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:19.706636 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7b89d8b6-0c06-4a8e-92df-229f991739eb tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:19.707195 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7b89d8b6-0c06-4a8e-92df-229f991739eb tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:19.708059 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7b89d8b6-0c06-4a8e-92df-229f991739eb tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:19.708502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7b89d8b6-0c06-4a8e-92df-229f991739eb tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:19.843604 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7b89d8b6-0c06-4a8e-92df-229f991739eb tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:19.851241 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7b89d8b6-0c06-4a8e-92df-229f991739eb tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1315 microversion: 2.1 time: 0.156219 Dec 15 11:39:19.851930 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 503/1004] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:19 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:39:19.872486 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:39:19.872906 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:39:19.873374 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:39:19.873775 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:39:19.874178 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:39:19.882487 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:19.883583 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:19.884422 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:19.884849 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:19.901314 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Getting quotas for project 6ff93e8f116741609e6914e602f4d118. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:39:19.905090 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Getting quotas for user 9687c82971da4f129b0e90662784d869 and project 6ff93e8f116741609e6914e602f4d118. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:39:19.916134 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:39:19.918265 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03786c1a-01dc-4180-a23f-dc99d0afebc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:39:19.962029 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-718b6c99-a66d-47a2-b23c-0150f8b148ba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487395 Dec 15 11:39:19.962683 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 502/1005] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:39:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:39:19.972695 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4103a597-43d8-47d1-9ecd-ade50b389310 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:19.973372 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4103a597-43d8-47d1-9ecd-ade50b389310 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:20.025401 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4103a597-43d8-47d1-9ecd-ade50b389310 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:20.031972 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4103a597-43d8-47d1-9ecd-ade50b389310 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1217 microversion: 2.1 time: 0.062968 Dec 15 11:39:20.032531 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 504/1006] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:19 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:20.869780 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4e3d3432-774b-4b86-9f18-1fe661e8e47d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:20.870832 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4e3d3432-774b-4b86-9f18-1fe661e8e47d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:20.878008 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e3d3432-774b-4b86-9f18-1fe661e8e47d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:20.878533 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e3d3432-774b-4b86-9f18-1fe661e8e47d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:20.879459 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e3d3432-774b-4b86-9f18-1fe661e8e47d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:20.879957 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e3d3432-774b-4b86-9f18-1fe661e8e47d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:21.049054 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0da3bf37-af3a-45be-972f-ad97369e70a5 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:21.049793 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-0da3bf37-af3a-45be-972f-ad97369e70a5 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:21.057517 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0da3bf37-af3a-45be-972f-ad97369e70a5 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:21.057978 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0da3bf37-af3a-45be-972f-ad97369e70a5 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:21.058794 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0da3bf37-af3a-45be-972f-ad97369e70a5 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:21.059226 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0da3bf37-af3a-45be-972f-ad97369e70a5 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:21.096828 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4e3d3432-774b-4b86-9f18-1fe661e8e47d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:21.104373 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4e3d3432-774b-4b86-9f18-1fe661e8e47d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1315 microversion: 2.1 time: 0.239749 Dec 15 11:39:21.104954 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 503/1007] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:20 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:21.127212 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-0da3bf37-af3a-45be-972f-ad97369e70a5 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:21.135392 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0da3bf37-af3a-45be-972f-ad97369e70a5 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1275 microversion: 2.1 time: 0.090050 Dec 15 11:39:21.136011 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 505/1008] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:21 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:39:21.390218 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-73820393-d912-4d39-9838-752de500f5aa req-a8411c52-b4e9-4b1a-986a-a538843e3920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb837c69-e994-4c61-baac-c931c5c8e5ba", "name": "network-vif-plugged", "status": "completed", "tag": "f4e18fbc-c4ab-46e9-805c-4d98dd6b3ea9"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:39:21.391868 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:39:21.391868 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:39:21.399201 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-73820393-d912-4d39-9838-752de500f5aa req-a8411c52-b4e9-4b1a-986a-a538843e3920 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:21.399660 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-73820393-d912-4d39-9838-752de500f5aa req-a8411c52-b4e9-4b1a-986a-a538843e3920 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:21.411899 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-73820393-d912-4d39-9838-752de500f5aa req-a8411c52-b4e9-4b1a-986a-a538843e3920 service nova] Creating event network-vif-plugged:f4e18fbc-c4ab-46e9-805c-4d98dd6b3ea9 for instance eb837c69-e994-4c61-baac-c931c5c8e5ba on hv-cinder-81321 Dec 15 11:39:21.417436 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-73820393-d912-4d39-9838-752de500f5aa req-a8411c52-b4e9-4b1a-986a-a538843e3920 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030854 Dec 15 11:39:21.418260 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 504/1009] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:39:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:39:22.121954 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-acf2266d-7359-43fc-a630-1990280709bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:22.122819 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-acf2266d-7359-43fc-a630-1990280709bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:22.129221 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-acf2266d-7359-43fc-a630-1990280709bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:22.129748 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-acf2266d-7359-43fc-a630-1990280709bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:22.130638 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-acf2266d-7359-43fc-a630-1990280709bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:22.131145 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-acf2266d-7359-43fc-a630-1990280709bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:22.153374 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a80589ce-9c15-44af-87bd-22f6cc441a98 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:22.154083 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a80589ce-9c15-44af-87bd-22f6cc441a98 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:22.160300 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a80589ce-9c15-44af-87bd-22f6cc441a98 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:22.160751 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a80589ce-9c15-44af-87bd-22f6cc441a98 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:22.161733 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a80589ce-9c15-44af-87bd-22f6cc441a98 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:22.162170 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a80589ce-9c15-44af-87bd-22f6cc441a98 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:22.291354 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-acf2266d-7359-43fc-a630-1990280709bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:22.301246 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-acf2266d-7359-43fc-a630-1990280709bf tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1315 microversion: 2.1 time: 0.183696 Dec 15 11:39:22.301916 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 506/1010] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:22 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:39:22.409024 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a80589ce-9c15-44af-87bd-22f6cc441a98 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:22.417211 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a80589ce-9c15-44af-87bd-22f6cc441a98 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1317 microversion: 2.1 time: 0.268370 Dec 15 11:39:22.417786 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 505/1011] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:22 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:39:22.541253 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-6ea12a95-7763-48e5-b05f-368e77ce72eb req-cbc4fc40-1902-4abf-a9b9-16b738936091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c710854-a560-4060-b407-7870a1056a98", "tag": "de632ca7-3cb7-492b-b6c7-ba5da2085656"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:39:22.544124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:39:22.544124 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:39:22.554999 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-6ea12a95-7763-48e5-b05f-368e77ce72eb req-cbc4fc40-1902-4abf-a9b9-16b738936091 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:22.555754 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-6ea12a95-7763-48e5-b05f-368e77ce72eb req-cbc4fc40-1902-4abf-a9b9-16b738936091 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:22.573217 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-6ea12a95-7763-48e5-b05f-368e77ce72eb req-cbc4fc40-1902-4abf-a9b9-16b738936091 service nova] Creating event network-changed:de632ca7-3cb7-492b-b6c7-ba5da2085656 for instance 7c710854-a560-4060-b407-7870a1056a98 on hv-cinder-81321 Dec 15 11:39:22.580242 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-6ea12a95-7763-48e5-b05f-368e77ce72eb req-cbc4fc40-1902-4abf-a9b9-16b738936091 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043736 Dec 15 11:39:22.580936 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 507/1012] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:39:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:39:23.316963 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-50596517-6edc-45c5-a602-4c9d76c939e9 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:23.317537 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-50596517-6edc-45c5-a602-4c9d76c939e9 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:23.324315 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50596517-6edc-45c5-a602-4c9d76c939e9 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:23.324765 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50596517-6edc-45c5-a602-4c9d76c939e9 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:23.325554 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50596517-6edc-45c5-a602-4c9d76c939e9 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:23.325995 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50596517-6edc-45c5-a602-4c9d76c939e9 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:23.434789 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2f80fce3-66ae-414f-a093-25936a1f893f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:23.435484 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2f80fce3-66ae-414f-a093-25936a1f893f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:23.441527 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f80fce3-66ae-414f-a093-25936a1f893f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:23.441976 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f80fce3-66ae-414f-a093-25936a1f893f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:23.442790 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f80fce3-66ae-414f-a093-25936a1f893f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:23.443230 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2f80fce3-66ae-414f-a093-25936a1f893f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:23.547697 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-50596517-6edc-45c5-a602-4c9d76c939e9 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:23.556531 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-50596517-6edc-45c5-a602-4c9d76c939e9 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1465 microversion: 2.1 time: 0.243227 Dec 15 11:39:23.557208 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 506/1013] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:23 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1465 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:23.578266 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2f80fce3-66ae-414f-a093-25936a1f893f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:23.586197 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2f80fce3-66ae-414f-a093-25936a1f893f tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1317 microversion: 2.1 time: 0.156687 Dec 15 11:39:23.587087 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 508/1014] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:23 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:39:23.594491 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4919bd48-27bf-422c-bf26-32bab9b5e08d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:23.595259 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4919bd48-27bf-422c-bf26-32bab9b5e08d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:23.601802 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4919bd48-27bf-422c-bf26-32bab9b5e08d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:23.602246 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4919bd48-27bf-422c-bf26-32bab9b5e08d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:23.603053 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4919bd48-27bf-422c-bf26-32bab9b5e08d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:23.603493 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4919bd48-27bf-422c-bf26-32bab9b5e08d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:23.628076 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4919bd48-27bf-422c-bf26-32bab9b5e08d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:39:23.698679 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4919bd48-27bf-422c-bf26-32bab9b5e08d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 204 len: 0 microversion: 2.1 time: 0.107510 Dec 15 11:39:23.699396 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 507/1015] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:39:23 2021] DELETE /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:39:23.709317 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-984c6361-cfb0-4022-9a0f-d0b6ca36036d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:23.709921 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-984c6361-cfb0-4022-9a0f-d0b6ca36036d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:23.716014 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-984c6361-cfb0-4022-9a0f-d0b6ca36036d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:23.716455 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-984c6361-cfb0-4022-9a0f-d0b6ca36036d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:23.717242 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-984c6361-cfb0-4022-9a0f-d0b6ca36036d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:23.717656 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-984c6361-cfb0-4022-9a0f-d0b6ca36036d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:23.850163 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-984c6361-cfb0-4022-9a0f-d0b6ca36036d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:23.858815 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-984c6361-cfb0-4022-9a0f-d0b6ca36036d tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1471 microversion: 2.1 time: 0.153372 Dec 15 11:39:23.859387 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 509/1016] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:23 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:24.603592 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a3d2be7b-b0be-491d-a4c4-1eeb4d6255fb tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:24.604287 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a3d2be7b-b0be-491d-a4c4-1eeb4d6255fb tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:24.610475 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3d2be7b-b0be-491d-a4c4-1eeb4d6255fb tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:24.610945 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3d2be7b-b0be-491d-a4c4-1eeb4d6255fb tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:24.611730 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3d2be7b-b0be-491d-a4c4-1eeb4d6255fb tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:24.612147 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3d2be7b-b0be-491d-a4c4-1eeb4d6255fb tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:24.741657 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a3d2be7b-b0be-491d-a4c4-1eeb4d6255fb tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:24.757103 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a3d2be7b-b0be-491d-a4c4-1eeb4d6255fb tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1317 microversion: 2.1 time: 0.157741 Dec 15 11:39:24.758301 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 508/1017] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:24 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:24.876437 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-07d853db-4525-40c4-82d9-3bad504f71d5 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:24.876974 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-07d853db-4525-40c4-82d9-3bad504f71d5 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:24.883950 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07d853db-4525-40c4-82d9-3bad504f71d5 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:24.884404 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07d853db-4525-40c4-82d9-3bad504f71d5 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:24.885188 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07d853db-4525-40c4-82d9-3bad504f71d5 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:24.885670 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-07d853db-4525-40c4-82d9-3bad504f71d5 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:25.019255 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-07d853db-4525-40c4-82d9-3bad504f71d5 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8831179a619a4673899b6220b09cc89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af67185dd56476c8155a9943c05156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:25.026640 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-07d853db-4525-40c4-82d9-3bad504f71d5 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 200 len: 1471 microversion: 2.1 time: 0.153908 Dec 15 11:39:25.027214 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 510/1018] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:24 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:25.465094 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-cfaf36dd-1fb0-493f-9c28-c39ccc95ca24 req-662a62a8-f51b-45c3-8acc-3c5716f5e4ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb837c69-e994-4c61-baac-c931c5c8e5ba", "name": "network-vif-deleted", "tag": "f4e18fbc-c4ab-46e9-805c-4d98dd6b3ea9"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:39:25.470240 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:39:25.470240 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:39:25.482009 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-cfaf36dd-1fb0-493f-9c28-c39ccc95ca24 req-662a62a8-f51b-45c3-8acc-3c5716f5e4ae service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:25.482453 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-cfaf36dd-1fb0-493f-9c28-c39ccc95ca24 req-662a62a8-f51b-45c3-8acc-3c5716f5e4ae service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:25.504208 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-cfaf36dd-1fb0-493f-9c28-c39ccc95ca24 req-662a62a8-f51b-45c3-8acc-3c5716f5e4ae service nova] Creating event network-vif-deleted:f4e18fbc-c4ab-46e9-805c-4d98dd6b3ea9 for instance eb837c69-e994-4c61-baac-c931c5c8e5ba on hv-cinder-81321 Dec 15 11:39:25.512195 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-cfaf36dd-1fb0-493f-9c28-c39ccc95ca24 req-662a62a8-f51b-45c3-8acc-3c5716f5e4ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050954 Dec 15 11:39:25.512795 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 509/1019] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:39:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:39:25.775233 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-badfc69d-e290-444f-8866-9f8d48d07785 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:25.775954 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-badfc69d-e290-444f-8866-9f8d48d07785 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:25.783147 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-badfc69d-e290-444f-8866-9f8d48d07785 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:25.783913 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-badfc69d-e290-444f-8866-9f8d48d07785 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:25.785301 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-badfc69d-e290-444f-8866-9f8d48d07785 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:25.786039 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-badfc69d-e290-444f-8866-9f8d48d07785 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:25.924309 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-badfc69d-e290-444f-8866-9f8d48d07785 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:25.932178 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-badfc69d-e290-444f-8866-9f8d48d07785 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1317 microversion: 2.1 time: 0.161299 Dec 15 11:39:25.932782 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 511/1020] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:25 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:26.043465 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ea19e188-fa16-4614-a640-f29367a854c3 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:26.044149 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ea19e188-fa16-4614-a640-f29367a854c3 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] [instance: eb837c69-e994-4c61-baac-c931c5c8e5ba] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:26.050500 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ea19e188-fa16-4614-a640-f29367a854c3 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:26.050971 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ea19e188-fa16-4614-a640-f29367a854c3 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:26.051729 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ea19e188-fa16-4614-a640-f29367a854c3 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:26.052155 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ea19e188-fa16-4614-a640-f29367a854c3 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:26.065197 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-ea19e188-fa16-4614-a640-f29367a854c3 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] HTTP exception thrown: Instance eb837c69-e994-4c61-baac-c931c5c8e5ba could not be found. Dec 15 11:39:26.065769 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ea19e188-fa16-4614-a640-f29367a854c3 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] Returning 404 to user: Instance eb837c69-e994-4c61-baac-c931c5c8e5ba could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:39:26.066560 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ea19e188-fa16-4614-a640-f29367a854c3 tempest-VolumesNegativeTest-1081117654 tempest-VolumesNegativeTest-1081117654-project] 10.222.0.18 "GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba" status: 404 len: 111 microversion: 2.1 time: 0.027187 Dec 15 11:39:26.067095 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 510/1021] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:26 2021] GET /compute/v2.1/servers/eb837c69-e994-4c61-baac-c931c5c8e5ba => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:39:26.948652 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5b5a8801-e744-4678-8151-275c2bf08689 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:26.949272 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5b5a8801-e744-4678-8151-275c2bf08689 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:26.955670 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b5a8801-e744-4678-8151-275c2bf08689 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:26.956161 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b5a8801-e744-4678-8151-275c2bf08689 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:26.956951 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b5a8801-e744-4678-8151-275c2bf08689 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:26.957388 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5b5a8801-e744-4678-8151-275c2bf08689 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:27.102648 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-5b5a8801-e744-4678-8151-275c2bf08689 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:27.110272 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5b5a8801-e744-4678-8151-275c2bf08689 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1317 microversion: 2.1 time: 0.165601 Dec 15 11:39:27.110880 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 512/1022] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:26 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:27.407528 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-5f05e546-0bca-41e7-a53c-45bfbabc08c9 req-2b980fd2-25f0-40e3-b3df-85019d69391d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c710854-a560-4060-b407-7870a1056a98", "name": "network-vif-plugged", "status": "completed", "tag": "de632ca7-3cb7-492b-b6c7-ba5da2085656"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:39:27.409309 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:39:27.409309 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:39:27.417634 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-5f05e546-0bca-41e7-a53c-45bfbabc08c9 req-2b980fd2-25f0-40e3-b3df-85019d69391d service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:27.418082 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-5f05e546-0bca-41e7-a53c-45bfbabc08c9 req-2b980fd2-25f0-40e3-b3df-85019d69391d service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:27.429574 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-5f05e546-0bca-41e7-a53c-45bfbabc08c9 req-2b980fd2-25f0-40e3-b3df-85019d69391d service nova] Creating event network-vif-plugged:de632ca7-3cb7-492b-b6c7-ba5da2085656 for instance 7c710854-a560-4060-b407-7870a1056a98 on hv-cinder-81321 Dec 15 11:39:27.434645 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-5f05e546-0bca-41e7-a53c-45bfbabc08c9 req-2b980fd2-25f0-40e3-b3df-85019d69391d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033158 Dec 15 11:39:27.435218 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 511/1023] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:39:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:39:28.126499 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-69ab3263-0054-4959-8920-86148c19eaac tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:28.127141 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-69ab3263-0054-4959-8920-86148c19eaac tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:28.133350 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69ab3263-0054-4959-8920-86148c19eaac tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:28.133797 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69ab3263-0054-4959-8920-86148c19eaac tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:28.134578 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69ab3263-0054-4959-8920-86148c19eaac tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:28.135015 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-69ab3263-0054-4959-8920-86148c19eaac tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:28.278094 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-69ab3263-0054-4959-8920-86148c19eaac tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:28.289769 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-69ab3263-0054-4959-8920-86148c19eaac tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1317 microversion: 2.1 time: 0.165991 Dec 15 11:39:28.290349 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 513/1024] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:28 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:29.307866 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9fe0cf11-68b2-4b35-acff-adf04f39b05e tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:29.308571 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9fe0cf11-68b2-4b35-acff-adf04f39b05e tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:29.314746 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9fe0cf11-68b2-4b35-acff-adf04f39b05e tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:29.315197 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9fe0cf11-68b2-4b35-acff-adf04f39b05e tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:29.315977 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9fe0cf11-68b2-4b35-acff-adf04f39b05e tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:29.316415 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9fe0cf11-68b2-4b35-acff-adf04f39b05e tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:29.447245 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9fe0cf11-68b2-4b35-acff-adf04f39b05e tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:29.454735 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9fe0cf11-68b2-4b35-acff-adf04f39b05e tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1506 microversion: 2.1 time: 0.151597 Dec 15 11:39:29.455306 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 512/1025] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:29 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:29.470551 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-0387bd6c-e0c2-48db-94de-7ed5d7151811 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93d85819-9b21-48cb-b129-bbbc1393ada0", "device": "/dev/sdb"}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:39:29.471657 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-0387bd6c-e0c2-48db-94de-7ed5d7151811 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:29.478408 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0387bd6c-e0c2-48db-94de-7ed5d7151811 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:29.478869 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0387bd6c-e0c2-48db-94de-7ed5d7151811 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:29.479639 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0387bd6c-e0c2-48db-94de-7ed5d7151811 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:29.480068 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-0387bd6c-e0c2-48db-94de-7ed5d7151811 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:29.706683 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-0387bd6c-e0c2-48db-94de-7ed5d7151811 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "POST /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239622 Dec 15 11:39:29.707297 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 514/1026] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 11:39:29 2021] POST /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:39:40.220046 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d9e33962-409c-4c91-a98b-aa3f4cad0b20 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Action: 'create', calling method: .version_select at 0x7fdf59821f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-50129748"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:39:40.236672 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-d9e33962-409c-4c91-a98b-aa3f4cad0b20 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Getting quotas for project 8bd72f92e01842d5b0f10841f3856619. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:39:40.240455 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-d9e33962-409c-4c91-a98b-aa3f4cad0b20 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Getting quotas for user 201fce34afd742b292672c7be1c5eef3 and project 8bd72f92e01842d5b0f10841f3856619. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:39:40.329176 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-d9e33962-409c-4c91-a98b-aa3f4cad0b20 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Getting quotas for project 8bd72f92e01842d5b0f10841f3856619. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:39:40.333317 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-d9e33962-409c-4c91-a98b-aa3f4cad0b20 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Getting quotas for user 201fce34afd742b292672c7be1c5eef3 and project 8bd72f92e01842d5b0f10841f3856619. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:39:40.346858 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d9e33962-409c-4c91-a98b-aa3f4cad0b20 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.293145 Dec 15 11:39:40.347601 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 513/1027] 10.222.0.18 () {60 vars in 1157 bytes} [Wed Dec 15 11:39:40 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:48.166585 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-5db69f0c-5a5c-4ccd-8caa-3230c8e1dfd1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:48.167169 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-5db69f0c-5a5c-4ccd-8caa-3230c8e1dfd1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:48.173270 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5db69f0c-5a5c-4ccd-8caa-3230c8e1dfd1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:48.173723 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5db69f0c-5a5c-4ccd-8caa-3230c8e1dfd1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:48.174501 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5db69f0c-5a5c-4ccd-8caa-3230c8e1dfd1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:48.174982 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-5db69f0c-5a5c-4ccd-8caa-3230c8e1dfd1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:48.372157 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.objects.instance [None req-5db69f0c-5a5c-4ccd-8caa-3230c8e1dfd1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lazy-loading 'services' on Instance uuid 7c710854-a560-4060-b407-7870a1056a98 {{(pid=116082) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:39:48.441441 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-5db69f0c-5a5c-4ccd-8caa-3230c8e1dfd1 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98/os-volume_attachments/93d85819-9b21-48cb-b129-bbbc1393ada0" status: 202 len: 0 microversion: 2.1 time: 0.279204 Dec 15 11:39:48.442083 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 515/1028] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 11:39:48 2021] DELETE /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98/os-volume_attachments/93d85819-9b21-48cb-b129-bbbc1393ada0 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 11:39:49.553526 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-135d7939-d9d4-4b34-ae9e-38b6ac248293 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:49.554175 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-135d7939-d9d4-4b34-ae9e-38b6ac248293 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:49.560689 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-135d7939-d9d4-4b34-ae9e-38b6ac248293 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:49.561129 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-135d7939-d9d4-4b34-ae9e-38b6ac248293 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:49.561890 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-135d7939-d9d4-4b34-ae9e-38b6ac248293 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:49.562316 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-135d7939-d9d4-4b34-ae9e-38b6ac248293 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:49.586960 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-135d7939-d9d4-4b34-ae9e-38b6ac248293 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:39:49.661385 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-135d7939-d9d4-4b34-ae9e-38b6ac248293 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 204 len: 0 microversion: 2.1 time: 0.111730 Dec 15 11:39:49.663240 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 514/1029] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:39:49 2021] DELETE /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:39:49.672221 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-ce836758-c050-4686-abe6-a3a223fafe47 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:49.673009 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-ce836758-c050-4686-abe6-a3a223fafe47 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:49.679314 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ce836758-c050-4686-abe6-a3a223fafe47 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:49.679759 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ce836758-c050-4686-abe6-a3a223fafe47 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:49.680564 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ce836758-c050-4686-abe6-a3a223fafe47 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:49.680998 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-ce836758-c050-4686-abe6-a3a223fafe47 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:49.817623 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-ce836758-c050-4686-abe6-a3a223fafe47 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:49.825722 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-ce836758-c050-4686-abe6-a3a223fafe47 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1512 microversion: 2.1 time: 0.158252 Dec 15 11:39:49.826303 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 516/1030] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:49 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:50.845062 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b1fa2ed7-a1bc-4eba-9015-ac13f3b3cc5a tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:50.845762 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b1fa2ed7-a1bc-4eba-9015-ac13f3b3cc5a tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:50.852054 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1fa2ed7-a1bc-4eba-9015-ac13f3b3cc5a tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:50.852493 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1fa2ed7-a1bc-4eba-9015-ac13f3b3cc5a tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:50.853264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1fa2ed7-a1bc-4eba-9015-ac13f3b3cc5a tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:50.853695 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1fa2ed7-a1bc-4eba-9015-ac13f3b3cc5a tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:50.988485 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b1fa2ed7-a1bc-4eba-9015-ac13f3b3cc5a tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:50.996443 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b1fa2ed7-a1bc-4eba-9015-ac13f3b3cc5a tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1512 microversion: 2.1 time: 0.155466 Dec 15 11:39:50.997002 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 515/1031] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:50 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:51.841981 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-9efa9877-934f-4095-83bc-25b6f64eab08 req-779adb63-0df6-4280-8108-ae510ee794fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c710854-a560-4060-b407-7870a1056a98", "name": "network-vif-deleted", "tag": "de632ca7-3cb7-492b-b6c7-ba5da2085656"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:39:51.843773 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:39:51.843773 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:39:51.851661 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-9efa9877-934f-4095-83bc-25b6f64eab08 req-779adb63-0df6-4280-8108-ae510ee794fe service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:51.852148 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-9efa9877-934f-4095-83bc-25b6f64eab08 req-779adb63-0df6-4280-8108-ae510ee794fe service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:51.863068 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-9efa9877-934f-4095-83bc-25b6f64eab08 req-779adb63-0df6-4280-8108-ae510ee794fe service nova] Creating event network-vif-deleted:de632ca7-3cb7-492b-b6c7-ba5da2085656 for instance 7c710854-a560-4060-b407-7870a1056a98 on hv-cinder-81321 Dec 15 11:39:51.869300 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-9efa9877-934f-4095-83bc-25b6f64eab08 req-779adb63-0df6-4280-8108-ae510ee794fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030880 Dec 15 11:39:51.869917 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 517/1032] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:39:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:39:52.013337 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fca511d5-bb36-4438-b9aa-cbb2c44844b6 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:52.013944 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fca511d5-bb36-4438-b9aa-cbb2c44844b6 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:52.020336 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fca511d5-bb36-4438-b9aa-cbb2c44844b6 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:52.020724 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fca511d5-bb36-4438-b9aa-cbb2c44844b6 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:52.021496 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fca511d5-bb36-4438-b9aa-cbb2c44844b6 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:52.021929 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fca511d5-bb36-4438-b9aa-cbb2c44844b6 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:52.055407 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fca511d5-bb36-4438-b9aa-cbb2c44844b6 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:52.055847 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fca511d5-bb36-4438-b9aa-cbb2c44844b6 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:52.056291 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-fca511d5-bb36-4438-b9aa-cbb2c44844b6 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lazy-loading 'fault' on Instance uuid 7c710854-a560-4060-b407-7870a1056a98 {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 11:39:52.094664 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fca511d5-bb36-4438-b9aa-cbb2c44844b6 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9687c82971da4f129b0e90662784d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff93e8f116741609e6914e602f4d118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:39:52.102356 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fca511d5-bb36-4438-b9aa-cbb2c44844b6 tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 200 len: 1307 microversion: 2.1 time: 0.092963 Dec 15 11:39:52.103159 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 516/1033] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:52 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:39:53.122450 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7565325a-7ca9-4b24-8380-3544e6287dba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:39:53.123188 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7565325a-7ca9-4b24-8380-3544e6287dba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] [instance: 7c710854-a560-4060-b407-7870a1056a98] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:39:53.129500 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7565325a-7ca9-4b24-8380-3544e6287dba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:53.129953 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7565325a-7ca9-4b24-8380-3544e6287dba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:53.130794 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7565325a-7ca9-4b24-8380-3544e6287dba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:39:53.131229 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7565325a-7ca9-4b24-8380-3544e6287dba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:39:53.144392 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.wsgi [None req-7565325a-7ca9-4b24-8380-3544e6287dba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] HTTP exception thrown: Instance 7c710854-a560-4060-b407-7870a1056a98 could not be found. Dec 15 11:39:53.144981 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7565325a-7ca9-4b24-8380-3544e6287dba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] Returning 404 to user: Instance 7c710854-a560-4060-b407-7870a1056a98 could not be found. {{(pid=116082) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:39:53.145800 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7565325a-7ca9-4b24-8380-3544e6287dba tempest-VolumesSnapshotTestJSON-1647940437 tempest-VolumesSnapshotTestJSON-1647940437-project] 10.222.0.18 "GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98" status: 404 len: 111 microversion: 2.1 time: 0.027939 Dec 15 11:39:53.146338 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 518/1034] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:39:53 2021] GET /compute/v2.1/servers/7c710854-a560-4060-b407-7870a1056a98 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:40:02.905292 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1205461496", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-50129748", "security_groups": [{"name": "tempest-secgroup-smoke-1619748194"}], "block_device_mapping_v2": [{"uuid": "583a6fcf-3db5-4518-abda-6f0f18a894bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1cdddff6-e22e-44fa-b522-abde99cbd87c"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:40:03.013039 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] validate_networks() for [('1cdddff6-e22e-44fa-b522-abde99cbd87c', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:40:03.383662 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:40:03.384075 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:40:03.384545 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:40:03.384947 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:40:03.385355 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:40:03.393908 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:03.394355 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:03.395191 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:03.395625 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:03.412110 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Getting quotas for project 8bd72f92e01842d5b0f10841f3856619. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:40:03.416135 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Getting quotas for user 201fce34afd742b292672c7be1c5eef3 and project 8bd72f92e01842d5b0f10841f3856619. Resources: {'cores', 'ram', 'instances'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:40:03.469329 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:40:03.471545 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='583a6fcf-3db5-4518-abda-6f0f18a894bd',volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:40:03.591775 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c8ed5a39-69c5-4ba8-bd7e-37b2ab6e2eb2 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.690045 Dec 15 11:40:03.592408 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 517/1035] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 11:40:02 2021] POST /compute/v2.1/servers => generated 406 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 11:40:03.602347 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-a61222a1-b15b-4861-9d5c-5c2bdd2899ae tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:03.602995 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-a61222a1-b15b-4861-9d5c-5c2bdd2899ae tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:03.670161 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-a61222a1-b15b-4861-9d5c-5c2bdd2899ae tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:03.677168 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-a61222a1-b15b-4861-9d5c-5c2bdd2899ae tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1093 microversion: 2.1 time: 0.078646 Dec 15 11:40:03.677874 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 519/1036] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:03 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:04.694809 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cf6ab281-d2b8-4b91-91f9-8dc4990a2a1f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:04.695965 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cf6ab281-d2b8-4b91-91f9-8dc4990a2a1f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:04.703210 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf6ab281-d2b8-4b91-91f9-8dc4990a2a1f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:04.704391 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf6ab281-d2b8-4b91-91f9-8dc4990a2a1f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:04.704735 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf6ab281-d2b8-4b91-91f9-8dc4990a2a1f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:04.705173 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf6ab281-d2b8-4b91-91f9-8dc4990a2a1f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:04.767271 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cf6ab281-d2b8-4b91-91f9-8dc4990a2a1f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:04.775218 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cf6ab281-d2b8-4b91-91f9-8dc4990a2a1f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1143 microversion: 2.1 time: 0.084221 Dec 15 11:40:04.775859 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 518/1037] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:04 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:05.792469 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7f1f2e30-d470-4933-94ae-471c18a65758 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:05.793080 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7f1f2e30-d470-4933-94ae-471c18a65758 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:05.799794 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7f1f2e30-d470-4933-94ae-471c18a65758 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:05.800242 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7f1f2e30-d470-4933-94ae-471c18a65758 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:05.801012 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7f1f2e30-d470-4933-94ae-471c18a65758 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:05.801469 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7f1f2e30-d470-4933-94ae-471c18a65758 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:05.863135 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7f1f2e30-d470-4933-94ae-471c18a65758 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:05.870743 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7f1f2e30-d470-4933-94ae-471c18a65758 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1143 microversion: 2.1 time: 0.082752 Dec 15 11:40:05.871313 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 520/1038] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:05 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:06.888110 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7e580a28-6d7a-461f-9f5b-46436c0188ba tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:06.889477 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7e580a28-6d7a-461f-9f5b-46436c0188ba tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:06.896186 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e580a28-6d7a-461f-9f5b-46436c0188ba tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:06.897008 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e580a28-6d7a-461f-9f5b-46436c0188ba tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:06.897967 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e580a28-6d7a-461f-9f5b-46436c0188ba tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:06.899572 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e580a28-6d7a-461f-9f5b-46436c0188ba tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:07.192793 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7e580a28-6d7a-461f-9f5b-46436c0188ba tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:07.202160 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7e580a28-6d7a-461f-9f5b-46436c0188ba tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.317578 Dec 15 11:40:07.202888 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 519/1039] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:06 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:07.836490 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-32658202-dbec-421f-a0a9-6fdbddbd22c3 req-b677508e-1380-41fb-9115-c2366c6e5666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2368f2e3-ea6d-4458-838b-1f2824111b43", "tag": "49dbc74c-7745-4fe8-838f-3d0fbfed1939"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:40:07.838393 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:40:07.838393 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:40:07.857205 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-32658202-dbec-421f-a0a9-6fdbddbd22c3 req-b677508e-1380-41fb-9115-c2366c6e5666 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:07.857761 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-32658202-dbec-421f-a0a9-6fdbddbd22c3 req-b677508e-1380-41fb-9115-c2366c6e5666 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:07.873237 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-32658202-dbec-421f-a0a9-6fdbddbd22c3 req-b677508e-1380-41fb-9115-c2366c6e5666 service nova] Creating event network-changed:49dbc74c-7745-4fe8-838f-3d0fbfed1939 for instance 2368f2e3-ea6d-4458-838b-1f2824111b43 on hv-cinder-81321 Dec 15 11:40:07.892874 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: Traceback (most recent call last): Dec 15 11:40:07.893175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 15 11:40:07.893175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: timer() Dec 15 11:40:07.893175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 15 11:40:07.893175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: cb(*args, **kw) Dec 15 11:40:07.893175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Dec 15 11:40:07.893175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: waiter.switch() Dec 15 11:40:07.893175 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: greenlet.error: cannot switch to a different thread Dec 15 11:40:07.894928 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-32658202-dbec-421f-a0a9-6fdbddbd22c3 req-b677508e-1380-41fb-9115-c2366c6e5666 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064695 Dec 15 11:40:07.895564 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 521/1040] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:40:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:40:08.220795 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3bae6137-34b6-4d16-9748-870c7a6ba25f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:08.222045 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3bae6137-34b6-4d16-9748-870c7a6ba25f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:08.228879 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3bae6137-34b6-4d16-9748-870c7a6ba25f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:08.229438 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3bae6137-34b6-4d16-9748-870c7a6ba25f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:08.230489 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3bae6137-34b6-4d16-9748-870c7a6ba25f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:08.230883 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3bae6137-34b6-4d16-9748-870c7a6ba25f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:08.456815 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3bae6137-34b6-4d16-9748-870c7a6ba25f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:08.464509 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3bae6137-34b6-4d16-9748-870c7a6ba25f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.247259 Dec 15 11:40:08.465092 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 520/1041] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:08 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:40:09.482487 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-4806d0fd-840e-4985-934e-d096214a85d4 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:09.483209 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-4806d0fd-840e-4985-934e-d096214a85d4 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:09.489308 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4806d0fd-840e-4985-934e-d096214a85d4 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:09.489753 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4806d0fd-840e-4985-934e-d096214a85d4 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:09.490523 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4806d0fd-840e-4985-934e-d096214a85d4 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:09.490985 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-4806d0fd-840e-4985-934e-d096214a85d4 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:09.637849 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-4806d0fd-840e-4985-934e-d096214a85d4 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:09.645407 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-4806d0fd-840e-4985-934e-d096214a85d4 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.167366 Dec 15 11:40:09.645970 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 522/1042] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:09 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:10.109896 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:40:10.110156 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: Wed Dec 15 11:40:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 11:40:10.662826 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-25686542-4248-4824-968d-27149535368d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:10.663469 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-25686542-4248-4824-968d-27149535368d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:10.670457 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-25686542-4248-4824-968d-27149535368d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:10.670934 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-25686542-4248-4824-968d-27149535368d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:10.671724 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-25686542-4248-4824-968d-27149535368d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:10.672160 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-25686542-4248-4824-968d-27149535368d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:10.861844 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-25686542-4248-4824-968d-27149535368d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:10.869637 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-25686542-4248-4824-968d-27149535368d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.210645 Dec 15 11:40:10.870195 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 521/1043] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:10 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:11.887867 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-2eecd5ef-b9a1-4aee-98be-7511c97eb13d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:11.888417 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-2eecd5ef-b9a1-4aee-98be-7511c97eb13d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:11.894793 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2eecd5ef-b9a1-4aee-98be-7511c97eb13d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:11.895239 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2eecd5ef-b9a1-4aee-98be-7511c97eb13d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:11.896047 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2eecd5ef-b9a1-4aee-98be-7511c97eb13d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:11.896477 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-2eecd5ef-b9a1-4aee-98be-7511c97eb13d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:12.029592 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-2eecd5ef-b9a1-4aee-98be-7511c97eb13d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:12.036863 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-2eecd5ef-b9a1-4aee-98be-7511c97eb13d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.154107 Dec 15 11:40:12.037422 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 523/1044] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:11 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:13.053363 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-44f1151e-bb21-4b35-ae62-dd131096155a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:13.053973 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-44f1151e-bb21-4b35-ae62-dd131096155a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:13.061010 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44f1151e-bb21-4b35-ae62-dd131096155a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:13.061463 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44f1151e-bb21-4b35-ae62-dd131096155a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:13.062240 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44f1151e-bb21-4b35-ae62-dd131096155a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:13.062705 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44f1151e-bb21-4b35-ae62-dd131096155a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:13.195715 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-44f1151e-bb21-4b35-ae62-dd131096155a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:13.202862 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-44f1151e-bb21-4b35-ae62-dd131096155a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.153235 Dec 15 11:40:13.203417 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 522/1045] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:13 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:14.220178 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-78e6effd-795a-4a69-9dbe-a6a7a03fdb48 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:14.220942 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-78e6effd-795a-4a69-9dbe-a6a7a03fdb48 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:14.228143 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78e6effd-795a-4a69-9dbe-a6a7a03fdb48 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:14.228589 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78e6effd-795a-4a69-9dbe-a6a7a03fdb48 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:14.229368 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78e6effd-795a-4a69-9dbe-a6a7a03fdb48 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:14.229802 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-78e6effd-795a-4a69-9dbe-a6a7a03fdb48 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:14.361906 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-78e6effd-795a-4a69-9dbe-a6a7a03fdb48 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:14.370232 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-78e6effd-795a-4a69-9dbe-a6a7a03fdb48 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.154009 Dec 15 11:40:14.370826 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 524/1046] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:14 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:15.387032 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-16f734b4-4af2-487f-843a-b9fc994e888d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:15.387638 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-16f734b4-4af2-487f-843a-b9fc994e888d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:15.393928 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-16f734b4-4af2-487f-843a-b9fc994e888d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:15.394368 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-16f734b4-4af2-487f-843a-b9fc994e888d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:15.395166 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-16f734b4-4af2-487f-843a-b9fc994e888d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:15.395593 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-16f734b4-4af2-487f-843a-b9fc994e888d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:15.529354 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-16f734b4-4af2-487f-843a-b9fc994e888d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:15.536681 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-16f734b4-4af2-487f-843a-b9fc994e888d tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.154042 Dec 15 11:40:15.537233 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 523/1047] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:15 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:16.553496 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-099a7429-f078-4ada-85a8-a540ca66a728 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:16.554235 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-099a7429-f078-4ada-85a8-a540ca66a728 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:16.561181 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-099a7429-f078-4ada-85a8-a540ca66a728 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:16.561630 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-099a7429-f078-4ada-85a8-a540ca66a728 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:16.562414 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-099a7429-f078-4ada-85a8-a540ca66a728 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:16.562882 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-099a7429-f078-4ada-85a8-a540ca66a728 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:16.787117 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-099a7429-f078-4ada-85a8-a540ca66a728 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:16.795398 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-099a7429-f078-4ada-85a8-a540ca66a728 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.245567 Dec 15 11:40:16.796015 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 525/1048] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:16 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:17.812733 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-197cec88-bac9-499b-9049-aab4e7035faf tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:17.813457 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-197cec88-bac9-499b-9049-aab4e7035faf tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:17.819739 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-197cec88-bac9-499b-9049-aab4e7035faf tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:17.820190 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-197cec88-bac9-499b-9049-aab4e7035faf tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:17.821007 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-197cec88-bac9-499b-9049-aab4e7035faf tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:17.822311 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-197cec88-bac9-499b-9049-aab4e7035faf tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:17.962811 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-197cec88-bac9-499b-9049-aab4e7035faf tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:17.970828 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-197cec88-bac9-499b-9049-aab4e7035faf tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.161807 Dec 15 11:40:17.971527 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 524/1049] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:17 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:18.987512 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-bfb4cbf1-7669-4cf6-a27c-3b193d735a3a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:18.988119 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-bfb4cbf1-7669-4cf6-a27c-3b193d735a3a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:18.995070 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfb4cbf1-7669-4cf6-a27c-3b193d735a3a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:18.995512 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfb4cbf1-7669-4cf6-a27c-3b193d735a3a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:18.996294 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfb4cbf1-7669-4cf6-a27c-3b193d735a3a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:18.996730 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-bfb4cbf1-7669-4cf6-a27c-3b193d735a3a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:19.127643 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-bfb4cbf1-7669-4cf6-a27c-3b193d735a3a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:19.135620 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-bfb4cbf1-7669-4cf6-a27c-3b193d735a3a tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.151786 Dec 15 11:40:19.136166 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 526/1050] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:18 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:20.153269 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-901179ac-66ba-4b3a-a29c-c7b80d091832 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:20.153978 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-901179ac-66ba-4b3a-a29c-c7b80d091832 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:20.160600 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-901179ac-66ba-4b3a-a29c-c7b80d091832 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:20.161047 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-901179ac-66ba-4b3a-a29c-c7b80d091832 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:20.161825 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-901179ac-66ba-4b3a-a29c-c7b80d091832 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:20.162256 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-901179ac-66ba-4b3a-a29c-c7b80d091832 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:20.298350 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-901179ac-66ba-4b3a-a29c-c7b80d091832 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:20.306646 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-901179ac-66ba-4b3a-a29c-c7b80d091832 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.157426 Dec 15 11:40:20.307079 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 525/1051] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:20 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:20.808856 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-96811847-f385-4b5c-9f27-0e071589b8f7 req-64b59ff6-0845-4b3c-a9c1-ddfcf886079a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2368f2e3-ea6d-4458-838b-1f2824111b43", "name": "network-vif-plugged", "status": "completed", "tag": "49dbc74c-7745-4fe8-838f-3d0fbfed1939"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:40:20.810376 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:40:20.810376 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:40:20.818167 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-96811847-f385-4b5c-9f27-0e071589b8f7 req-64b59ff6-0845-4b3c-a9c1-ddfcf886079a service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:20.818715 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-96811847-f385-4b5c-9f27-0e071589b8f7 req-64b59ff6-0845-4b3c-a9c1-ddfcf886079a service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:20.832502 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-96811847-f385-4b5c-9f27-0e071589b8f7 req-64b59ff6-0845-4b3c-a9c1-ddfcf886079a service nova] Creating event network-vif-plugged:49dbc74c-7745-4fe8-838f-3d0fbfed1939 for instance 2368f2e3-ea6d-4458-838b-1f2824111b43 on hv-cinder-81321 Dec 15 11:40:20.839304 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-96811847-f385-4b5c-9f27-0e071589b8f7 req-64b59ff6-0845-4b3c-a9c1-ddfcf886079a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034088 Dec 15 11:40:20.840096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 527/1052] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:40:21.323691 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-60020224-d249-495c-9d69-f6c0bb2a5da8 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:21.324331 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-60020224-d249-495c-9d69-f6c0bb2a5da8 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:21.330889 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60020224-d249-495c-9d69-f6c0bb2a5da8 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:21.331340 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60020224-d249-495c-9d69-f6c0bb2a5da8 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:21.332176 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60020224-d249-495c-9d69-f6c0bb2a5da8 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:21.332613 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60020224-d249-495c-9d69-f6c0bb2a5da8 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:21.466835 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-60020224-d249-495c-9d69-f6c0bb2a5da8 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:21.474100 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-60020224-d249-495c-9d69-f6c0bb2a5da8 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.154616 Dec 15 11:40:21.474675 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 526/1053] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:21 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:22.491844 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-67ee5086-219e-45ab-909f-589de537e4ef tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:22.492546 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-67ee5086-219e-45ab-909f-589de537e4ef tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:22.499395 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-67ee5086-219e-45ab-909f-589de537e4ef tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:22.499919 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-67ee5086-219e-45ab-909f-589de537e4ef tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:22.500763 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-67ee5086-219e-45ab-909f-589de537e4ef tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:22.501275 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-67ee5086-219e-45ab-909f-589de537e4ef tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:22.643577 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-67ee5086-219e-45ab-909f-589de537e4ef tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:22.651868 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-67ee5086-219e-45ab-909f-589de537e4ef tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1265 microversion: 2.1 time: 0.164474 Dec 15 11:40:22.652693 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 528/1054] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:22 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:23.669898 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-941e1c71-0755-4833-9c11-2c38429e456c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:23.670507 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-941e1c71-0755-4833-9c11-2c38429e456c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:23.676462 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-941e1c71-0755-4833-9c11-2c38429e456c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:23.676916 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-941e1c71-0755-4833-9c11-2c38429e456c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:23.677673 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-941e1c71-0755-4833-9c11-2c38429e456c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:23.678106 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-941e1c71-0755-4833-9c11-2c38429e456c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:23.810015 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-941e1c71-0755-4833-9c11-2c38429e456c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:23.817403 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-941e1c71-0755-4833-9c11-2c38429e456c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1453 microversion: 2.1 time: 0.151270 Dec 15 11:40:23.817950 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 527/1055] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:23 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:23.833500 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-7e86bcdd-6dc5-45b9-90dc-1cb678d11e27 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:40:23.834629 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-7e86bcdd-6dc5-45b9-90dc-1cb678d11e27 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:40:23.841506 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e86bcdd-6dc5-45b9-90dc-1cb678d11e27 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:23.841957 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e86bcdd-6dc5-45b9-90dc-1cb678d11e27 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:23.842792 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e86bcdd-6dc5-45b9-90dc-1cb678d11e27 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:23.843232 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-7e86bcdd-6dc5-45b9-90dc-1cb678d11e27 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:23.973068 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-7e86bcdd-6dc5-45b9-90dc-1cb678d11e27 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:40:23.981396 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-7e86bcdd-6dc5-45b9-90dc-1cb678d11e27 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1453 microversion: 2.1 time: 0.151479 Dec 15 11:40:23.981961 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 529/1056] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:40:23 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:40:25.820411 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-3b3e5d0f-dbcd-4269-95a6-74b0c5bf189c req-c7457a9c-6ab7-4b08-9229-1131ebd71575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2368f2e3-ea6d-4458-838b-1f2824111b43", "tag": "49dbc74c-7745-4fe8-838f-3d0fbfed1939"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:40:25.823062 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:40:25.823062 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 11:40:25.831587 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-3b3e5d0f-dbcd-4269-95a6-74b0c5bf189c req-c7457a9c-6ab7-4b08-9229-1131ebd71575 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:40:25.832022 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-3b3e5d0f-dbcd-4269-95a6-74b0c5bf189c req-c7457a9c-6ab7-4b08-9229-1131ebd71575 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:40:25.845321 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-3b3e5d0f-dbcd-4269-95a6-74b0c5bf189c req-c7457a9c-6ab7-4b08-9229-1131ebd71575 service nova] Creating event network-changed:49dbc74c-7745-4fe8-838f-3d0fbfed1939 for instance 2368f2e3-ea6d-4458-838b-1f2824111b43 on hv-cinder-81321 Dec 15 11:40:25.859596 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-3b3e5d0f-dbcd-4269-95a6-74b0c5bf189c req-c7457a9c-6ab7-4b08-9229-1131ebd71575 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045993 Dec 15 11:40:25.860410 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 528/1057] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:40:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:42:20.964024 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: ERROR oslo.messaging._drivers.impl_rabbit [-] [532c05d2-6702-446c-b8cd-6f004088be39] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 11:42:20.968191 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-29248459-5c4f-47f4-b5f6-16a07d250764 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:42:20.968687 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-29248459-5c4f-47f4-b5f6-16a07d250764 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:42:20.974553 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-29248459-5c4f-47f4-b5f6-16a07d250764 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:20.975023 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-29248459-5c4f-47f4-b5f6-16a07d250764 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:20.975806 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-29248459-5c4f-47f4-b5f6-16a07d250764 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:20.976238 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-29248459-5c4f-47f4-b5f6-16a07d250764 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:21.000501 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-29248459-5c4f-47f4-b5f6-16a07d250764 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Going to try to terminate instance {{(pid=116082) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 11:42:21.075575 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-29248459-5c4f-47f4-b5f6-16a07d250764 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 204 len: 0 microversion: 2.1 time: 0.113348 Dec 15 11:42:21.076571 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 530/1058] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:42:20 2021] DELETE /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 11:42:21.087036 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b3ee8825-9885-4c62-9f23-902fc260707f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:42:21.087726 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b3ee8825-9885-4c62-9f23-902fc260707f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:42:21.094289 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3ee8825-9885-4c62-9f23-902fc260707f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:21.094756 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3ee8825-9885-4c62-9f23-902fc260707f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:21.095520 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3ee8825-9885-4c62-9f23-902fc260707f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:21.095947 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3ee8825-9885-4c62-9f23-902fc260707f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:21.224874 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b3ee8825-9885-4c62-9f23-902fc260707f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:42:21.232869 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b3ee8825-9885-4c62-9f23-902fc260707f tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1577 microversion: 2.1 time: 0.150656 Dec 15 11:42:21.233807 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 529/1059] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:42:21 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:42:22.251343 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-f5746366-d70a-4a03-a5c1-ef4c1a06e425 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:42:22.252034 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-f5746366-d70a-4a03-a5c1-ef4c1a06e425 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116082) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:42:22.269096 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f5746366-d70a-4a03-a5c1-ef4c1a06e425 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:22.269549 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f5746366-d70a-4a03-a5c1-ef4c1a06e425 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:22.270341 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f5746366-d70a-4a03-a5c1-ef4c1a06e425 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:22.270829 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-f5746366-d70a-4a03-a5c1-ef4c1a06e425 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:22.286961 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO oslo.messaging._drivers.impl_rabbit [-] [532c05d2-6702-446c-b8cd-6f004088be39] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55186. Dec 15 11:42:22.405420 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.policy [None req-f5746366-d70a-4a03-a5c1-ef4c1a06e425 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116082) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:42:22.412754 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [None req-f5746366-d70a-4a03-a5c1-ef4c1a06e425 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1577 microversion: 2.1 time: 0.166083 Dec 15 11:42:22.413322 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 531/1060] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:42:22 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 11:42:23.431857 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c457b287-93dd-44b1-89e9-d97b4c0d1b5c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:42:23.432660 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c457b287-93dd-44b1-89e9-d97b4c0d1b5c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:42:23.440368 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c457b287-93dd-44b1-89e9-d97b4c0d1b5c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:23.440911 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c457b287-93dd-44b1-89e9-d97b4c0d1b5c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:23.441855 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c457b287-93dd-44b1-89e9-d97b4c0d1b5c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:23.442354 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c457b287-93dd-44b1-89e9-d97b4c0d1b5c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:23.526691 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c457b287-93dd-44b1-89e9-d97b4c0d1b5c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '201fce34afd742b292672c7be1c5eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd72f92e01842d5b0f10841f3856619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 11:42:23.535773 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c457b287-93dd-44b1-89e9-d97b4c0d1b5c tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 200 len: 1509 microversion: 2.1 time: 0.108479 Dec 15 11:42:23.536744 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 530/1061] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:42:23 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 1509 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 11:42:23.677340 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [req-b141c575-3ab0-4f4c-aa59-c1333ea69b91 req-e9c326e2-2158-4691-9211-7d68cd8b0b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2368f2e3-ea6d-4458-838b-1f2824111b43", "name": "network-vif-deleted", "tag": "49dbc74c-7745-4fe8-838f-3d0fbfed1939"}]} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:42:23.679605 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 11:42:23.679605 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: warnings.warn(msg) Dec 15 11:42:23.688298 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-b141c575-3ab0-4f4c-aa59-c1333ea69b91 req-e9c326e2-2158-4691-9211-7d68cd8b0b35 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:23.689821 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [req-b141c575-3ab0-4f4c-aa59-c1333ea69b91 req-e9c326e2-2158-4691-9211-7d68cd8b0b35 service nova] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:23.701650 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.compute.server_external_events [req-b141c575-3ab0-4f4c-aa59-c1333ea69b91 req-e9c326e2-2158-4691-9211-7d68cd8b0b35 service nova] Creating event network-vif-deleted:49dbc74c-7745-4fe8-838f-3d0fbfed1939 for instance 2368f2e3-ea6d-4458-838b-1f2824111b43 on hv-cinder-81321 Dec 15 11:42:23.706922 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO nova.api.openstack.requestlog [req-b141c575-3ab0-4f4c-aa59-c1333ea69b91 req-e9c326e2-2158-4691-9211-7d68cd8b0b35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274747 Dec 15 11:42:23.707508 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: [pid: 116082|app: 0|req: 532/1062] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 11:42:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 11:42:24.552988 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b6019f60-ab1a-453e-bff3-1bbef1d9e03e tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:42:24.553592 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b6019f60-ab1a-453e-bff3-1bbef1d9e03e tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:42:24.560011 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b6019f60-ab1a-453e-bff3-1bbef1d9e03e tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:24.560512 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b6019f60-ab1a-453e-bff3-1bbef1d9e03e tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:24.561347 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b6019f60-ab1a-453e-bff3-1bbef1d9e03e tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:24.561773 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b6019f60-ab1a-453e-bff3-1bbef1d9e03e tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:24.574687 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-b6019f60-ab1a-453e-bff3-1bbef1d9e03e tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] HTTP exception thrown: Instance 2368f2e3-ea6d-4458-838b-1f2824111b43 could not be found. Dec 15 11:42:24.575264 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b6019f60-ab1a-453e-bff3-1bbef1d9e03e tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Returning 404 to user: Instance 2368f2e3-ea6d-4458-838b-1f2824111b43 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:42:24.576593 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b6019f60-ab1a-453e-bff3-1bbef1d9e03e tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 404 len: 111 microversion: 2.1 time: 0.026787 Dec 15 11:42:24.577190 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 531/1063] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:42:24 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 11:42:24.668636 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.api.openstack.wsgi [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-553319491", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-50129748", "security_groups": [{"name": "tempest-secgroup-smoke-1619748194"}], "block_device_mapping_v2": [{"uuid": "583a6fcf-3db5-4518-abda-6f0f18a894bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1cdddff6-e22e-44fa-b522-abde99cbd87c"}]}} {{(pid=116082) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 11:42:24.777008 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.network.neutron [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] validate_networks() for [('1cdddff6-e22e-44fa-b522-abde99cbd87c', None, None, None, None, None)] {{(pid=116082) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 11:42:25.474547 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Flavor limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 11:42:25.475001 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Image limits 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 11:42:25.475474 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Flavor pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 11:42:25.475908 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Image pref 0:0:0 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 11:42:25.476314 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.virt.hardware [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116082) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 11:42:25.485314 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:25.485760 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:25.486579 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:42:25.487019 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG oslo_concurrency.lockutils [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116082) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:42:25.503512 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Getting quotas for project 8bd72f92e01842d5b0f10841f3856619. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 11:42:25.507470 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.quota [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Getting quotas for user 201fce34afd742b292672c7be1c5eef3 and project 8bd72f92e01842d5b0f10841f3856619. Resources: {'cores', 'ram', 'instances'} {{(pid=116082) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 11:42:25.560846 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Going to run 1 instances... {{(pid=116082) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 11:42:25.563098 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: DEBUG nova.compute.api [None req-80d99c36-e8fa-40a6-b791-ba166f11d574 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 7a12ce70-6942-42a7-a216-3369818aee24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='583a6fcf-3db5-4518-abda-6f0f18a894bd',volume_size=None,volume_type=None)] {{(pid=116082) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 11:43:12.598848 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:43:12.599441 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:43:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 11:43:25.187132 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c1d4d7a6-7865-4ad9-b8d8-f431db5674ca tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:43:25.187746 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c1d4d7a6-7865-4ad9-b8d8-f431db5674ca tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:43:25.193764 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1d4d7a6-7865-4ad9-b8d8-f431db5674ca tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:43:25.194214 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1d4d7a6-7865-4ad9-b8d8-f431db5674ca tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:43:25.195041 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1d4d7a6-7865-4ad9-b8d8-f431db5674ca tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:43:25.195476 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c1d4d7a6-7865-4ad9-b8d8-f431db5674ca tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:43:25.209016 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-c1d4d7a6-7865-4ad9-b8d8-f431db5674ca tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] HTTP exception thrown: Instance 2368f2e3-ea6d-4458-838b-1f2824111b43 could not be found. Dec 15 11:43:25.209626 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c1d4d7a6-7865-4ad9-b8d8-f431db5674ca tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Returning 404 to user: Instance 2368f2e3-ea6d-4458-838b-1f2824111b43 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:43:25.210441 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c1d4d7a6-7865-4ad9-b8d8-f431db5674ca tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 404 len: 111 microversion: 2.1 time: 0.028773 Dec 15 11:43:25.211010 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 532/1064] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 11:43:25 2021] DELETE /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 11:43:25.218620 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9c776475-047b-4c5e-ba83-5a5b413b34de tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:43:25.219224 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9c776475-047b-4c5e-ba83-5a5b413b34de tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] [instance: 2368f2e3-ea6d-4458-838b-1f2824111b43] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 11:43:25.224735 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c776475-047b-4c5e-ba83-5a5b413b34de tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:43:25.225181 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c776475-047b-4c5e-ba83-5a5b413b34de tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:43:25.225945 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c776475-047b-4c5e-ba83-5a5b413b34de tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 11:43:25.226378 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9c776475-047b-4c5e-ba83-5a5b413b34de tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Lock "a2ae07d7-a922-431d-b06a-73b88198aa10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 11:43:25.239488 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-9c776475-047b-4c5e-ba83-5a5b413b34de tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] HTTP exception thrown: Instance 2368f2e3-ea6d-4458-838b-1f2824111b43 could not be found. Dec 15 11:43:25.240064 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9c776475-047b-4c5e-ba83-5a5b413b34de tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Returning 404 to user: Instance 2368f2e3-ea6d-4458-838b-1f2824111b43 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 11:43:25.240888 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9c776475-047b-4c5e-ba83-5a5b413b34de tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43" status: 404 len: 111 microversion: 2.1 time: 0.025834 Dec 15 11:43:25.241393 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 533/1065] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 11:43:25 2021] GET /compute/v2.1/servers/2368f2e3-ea6d-4458-838b-1f2824111b43 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 11:43:30.127371 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:43:30.127919 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: Wed Dec 15 11:43:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Dec 15 11:43:32.054766 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:43:32.055357 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:43:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 11:45:05.981448 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:45:05.982190 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:45:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 11:45:20.203180 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:45:20.203664 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: Wed Dec 15 11:45:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Dec 15 11:46:32.616814 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:46:32.617412 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:46:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 11:46:50.145822 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:46:50.146439 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: Wed Dec 15 11:46:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Dec 15 11:46:52.071491 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:46:52.072071 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:46:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 11:48:25.998343 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:48:25.999019 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:48:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 11:48:40.220458 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:48:40.220970 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: Wed Dec 15 11:48:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Dec 15 11:49:26.032967 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc4fb7b8-c10b-46c8-9c20-835c8b3647e6] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 11:49:26.036825 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-52fb5565-39dd-4a20-8b27-bb5245a20df9 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] Calling method '.version_select at 0x7fdf5999ed30>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 11:49:26.061463 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-52fb5565-39dd-4a20-8b27-bb5245a20df9 tempest-TestVolumeBootPattern-1119237408 tempest-TestVolumeBootPattern-1119237408-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-50129748" status: 202 len: 0 microversion: 2.1 time: 0.032158 Dec 15 11:49:26.062050 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 534/1066] 10.222.0.18 () {58 vars in 1256 bytes} [Wed Dec 15 11:49:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-50129748 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 11:49:52.634080 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:49:52.634692 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:49:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 11:50:10.163117 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:50:10.163618 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: Wed Dec 15 11:50:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Dec 15 11:50:12.087837 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:50:12.088329 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:50:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 11:52:00.237243 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:52:00.237725 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: Wed Dec 15 11:52:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Dec 15 11:53:12.652598 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:53:12.653225 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:53:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 11:53:30.181673 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:53:30.181673 dv-cinder-813219-3-iscsi devstack@n-api.service[116082]: Wed Dec 15 11:53:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Dec 15 11:53:32.104940 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 11:53:32.105522 dv-cinder-813219-3-iscsi devstack@n-api.service[116083]: Wed Dec 15 11:53:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!